-- Logs begin at Mon 2022-02-28 09:51:53 UTC, end at Mon 2022-02-28 11:01:10 UTC. -- Feb 28 10:23:41.105643 dv-cinder-831167-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 28 10:23:41.113446 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 28 10:23:41 2022] *** Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: nodename: dv-cinder-831167-1-iscsi Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: machine: x86_64 Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: clock source: unix Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: pcre jit disabled Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: detected number of CPU cores: 4 Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: current working directory: / Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: detected binary path: /usr/bin/uwsgi-core Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: your processes number limit is 47680 Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: your memory page size is 4096 bytes Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: detected max file descriptor number: 2048 Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: lock engine: pthread robust mutexes Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: thunder lock: enabled Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 28 10:23:41.117698 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 28 10:23:41.164502 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: Python main interpreter initialized at 0x5633bb52a9c0 Feb 28 10:23:41.164502 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: python threads support enabled Feb 28 10:23:41.164502 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: your server socket listen backlog is limited to 100 connections Feb 28 10:23:41.164502 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: your mercy for graceful operations on workers is 90 seconds Feb 28 10:23:41.164888 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: mapped 403077 bytes (393 KB) for 2 cores Feb 28 10:23:41.164964 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: *** Operational MODE: preforking *** Feb 28 10:23:41.165201 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: *** uWSGI is running in multiple interpreter mode *** Feb 28 10:23:41.165201 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: spawned uWSGI master process (pid: 79315) Feb 28 10:23:41.165409 dv-cinder-831167-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 28 10:23:41.170956 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: spawned uWSGI worker 1 (pid: 79326, cores: 1) Feb 28 10:23:41.170956 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: spawned uWSGI worker 2 (pid: 79327, cores: 1) Feb 28 10:23:41.170956 dv-cinder-831167-1-iscsi devstack@keystone.service[79315]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 28 10:23:46.913786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:23:46.913786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: from cryptography.utils import int_from_bytes Feb 28 10:23:46.914526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:23:46.914526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: from cryptography.utils import int_from_bytes Feb 28 10:23:46.915310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:23:46.915310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: from cryptography.utils import int_from_bytes Feb 28 10:23:46.915757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:23:46.915757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: from cryptography.utils import int_from_bytes Feb 28 10:23:46.960716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 10:23:46.960887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 10:23:46.961077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] command line args: [] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 10:23:46.961333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 10:23:46.961505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ================================================================================ {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 10:23:46.961753 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] admin_token = **** {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.961982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 10:23:46.962067 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] config_dir = [] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.962196 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.962282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 10:23:46.962356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] config_source = [] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.962422 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] command line args: [] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 10:23:46.962482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] debug = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.962661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 10:23:46.962750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965011 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ================================================================================ {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 10:23:46.965011 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] admin_token = **** {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] config_dir = [] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] config_source = [] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965559 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] debug = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] list_limit = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965782 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] log_config_append = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.965962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] log_dir = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] log_file = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966204 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966331 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] list_limit = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] log_config_append = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966682 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] log_dir = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966746 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966811 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] log_file = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.966875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.967432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.967673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.967877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.968095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.968306 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.968507 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.968676 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.968877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.969078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.969312 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.969539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.969742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.969909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.970104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.970298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.970541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.970740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.970948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.971167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.971167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.971566 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.971733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.971933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] publish_errors = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.972128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.972335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.972509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.972649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.972649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.972954 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.973124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.973124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.973384 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.973384 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] publish_errors = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.973634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] standard_threads = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.973803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.973992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.974132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.974262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.974397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.974541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.974541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] use_journal = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.974798 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.974955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] use_json = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.975100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.975392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] use_stderr = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.975392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] use_syslog = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.975686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] standard_threads = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.975819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.975948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.976076 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.976204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.976204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.976463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.976593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] use_journal = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.976727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.976866 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] use_json = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.976866 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] use_stderr = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.977120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.977257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] use_syslog = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.977389 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.977523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:23:46.977653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.977781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.977921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.978051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.978185 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.978313 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.978448 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.978578 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.978793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.978978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.979116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.979251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.979381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.979517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.979647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.979783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.979912 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.980046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.980176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.980312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.980443 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.980443 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.980711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.980840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.980969 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.980969 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.981226 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.981357 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.981492 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.981492 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.981740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.981878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.982007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.982007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.982260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.982389 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.982516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.982516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.982768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.982952 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.983091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.983229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.983358 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.983496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.983626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.983761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.983890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.984019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.984160 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.984302 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.984433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.984563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.984690 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.984825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.984955 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.985158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.985290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.985418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.985552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.985682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.985810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.985958 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.986090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.986218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.986352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.986482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.986610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.986748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.986878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.987047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.987179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.987325 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.987455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.988095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.988095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.988362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.988545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.988725 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.988866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.988996 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.989123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.989253 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.989380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.989508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.989683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.989907 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.990078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.990213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.991515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.991694 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.991936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.992105 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.992302 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.992497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.992692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.992886 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.993124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.993291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.993551 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.993756 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.993955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.994125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.994370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.994574 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.994742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.994999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.995226 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.995396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.995631 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.995798 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.996027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.996197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.996391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.996595 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.996771 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.996961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.997097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.997236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.997405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.997539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.997669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.997798 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.997936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.998099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.998233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.998362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.998491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.998630 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.998773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.998929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.999067 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.999196 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.999326 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.999488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.999637 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.999770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:46.999900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.000029 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.000159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.000288 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.000430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.000561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.000708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.000839 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.000968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.001097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.001234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.001366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.001504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.001636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.001773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.001904 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.002169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.002307 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.002437 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.002567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.002567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.002822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.002992 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.002992 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.003369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.003999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.003999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.004254 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.004393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.004524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.004653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.004653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.004899 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.005047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.005047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.005294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.005422 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.005551 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.005681 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.005681 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.005947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.006091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.006091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.006340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.006470 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.006600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.006729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.006729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.007061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.007193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.007193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.007460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.007591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.007734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.007867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.007867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.008113 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.008243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.008373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.008512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.008512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.008773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.008909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.009041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.009172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] auth.external = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.009172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.009427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.009557 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.009689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.009819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.009819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] auth.password = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.010075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.010235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] auth.token = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.010379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] auth.external = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.010785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.010785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.011061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.011194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.011194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.011457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.011592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.011722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.011853 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.011853 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.012100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] auth.password = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.012240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] credential.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.012374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] auth.token = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.012504 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.012504 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.012762 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.012901 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.012901 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.013150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.013281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.013411 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.013541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.013679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.013812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.013812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.014069 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.014200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.014200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.014473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.014612 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.014745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.014875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.016129 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] credential.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.016266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.016266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.016531 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.016663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.016663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] federation.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.016917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.017056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.017222 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.017367 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.017367 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.017617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.017746 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.017877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.018016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.018150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.018291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.018291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.018547 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.018680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.018819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.018971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.018971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.019235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.019366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.019366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.019701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.019837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.019968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.020100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.020100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.020347 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.020489 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.020489 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.020740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.020871 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.021013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.021145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.021145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.021404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.021535 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.021667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] federation.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.021797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.021797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.022051 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.022190 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.022190 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.022439 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.022570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.022713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.022852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.022852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.023150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.023282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.023413 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.023545 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.023545 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.023811 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.023950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.024082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.024213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.024213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.024468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.024615 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.024615 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.024863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.024994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.025133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.025265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.025265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.025516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.025654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.025785 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.025925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.025925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.026172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.026313 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.026444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.026575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.026575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.026831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.026989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.027121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.027252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.027252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.027509 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.027509 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.027758 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.027888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.028020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.028160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.028310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.028310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.028559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.028689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.028819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.028949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.028949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.029206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.029343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.029475 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.029607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.029607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.029862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.030004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.030137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.030274 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.030274 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.030528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.030674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.030674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.030968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031195 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031195 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031560 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031632 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031712 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031914 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.031985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032055 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032406 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032624 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.032976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033321 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033901 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.033973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034044 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034251 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034403 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034547 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034618 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.034843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035200 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035364 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] resource.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.035962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036033 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036546 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036837 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036917 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.036917 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] role.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] role.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.037675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038129 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.038778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039065 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039383 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039450 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] token.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039886 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.039965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.040102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.040591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.040591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.040809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.040934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.041053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.041167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.041283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.041478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.041601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.041726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.041942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.042064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.042180 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.042376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.042498 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.042623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.042807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.042947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.043128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.043248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.043386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.043602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.043732 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.043935 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.connection = **** {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.044064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.044193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.044358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.044480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.044642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.044772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.044891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.045108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.045234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.045351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.045521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.045652 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.045793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.045941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.046070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.046264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.046382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.046508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.046720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.046842 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.047005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.047125 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.047241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.047480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.047601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.047718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.047880 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.048002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.048164 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.048293 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.048419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 10:23:47.048632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.048951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.049273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.049572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.049879 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.050731 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] resource.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.051074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.051395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.051704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.052028 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.052350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.052670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.053115 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.053428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.053740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.054048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] role.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.054365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] role.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.054670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.055013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.055334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.055655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.055974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.056292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.056611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.056945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.057265 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.057570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.057889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.058208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.058528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.058845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.059385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.059688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.060009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.060330 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.060651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.060969 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.061288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.061612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.061934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.062244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.062544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.062847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.063167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.063487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.063813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.064130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.064434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.064738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.065039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.065342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] token.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.065660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.066547 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.066854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.067203 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.067522 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.067830 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.068143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.068457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.068773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.069086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.069392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.069692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.070009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.070340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.070639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.070976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.071340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.071676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.connection = **** {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.071994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.072311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.072620 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.072931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.073238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.073544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.073849 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.074155 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.074469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.074788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.075118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.075425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.075741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.076046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.076359 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.076657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.076964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.077266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:23:47.077498 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 10:23:47.080337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.080569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.082469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.089551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.109670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.109981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.110275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.118778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.119036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.119676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.139161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.139466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.172827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.178697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.225084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.225341 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.226672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.226995 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.293126 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.293392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.293392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.293653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.293775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.293775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.293999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.294126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.294246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.294364 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.294545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.294821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.319949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.320198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.320392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.320518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.320639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.320805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.320938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.321058 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.321174 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.321298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.321511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.321789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.322063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.322335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.332763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.333015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.346040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.346244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.346369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.346486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.346604 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.346819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.347478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.347613 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.347732 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.347851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.348007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.348139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.348381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.348660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:23:47.366274 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.366473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 10:23:47.366789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.366937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.367057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 10:23:47.367199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 10:23:47.367465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.367668 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.367806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.367973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.368096 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 10:23:47.368212 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.368399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.368722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.369042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.369361 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.379080 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.379372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.379638 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.379916 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.380611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.380968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.381302 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.381654 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.388330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.390025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.391587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.391866 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.392148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.392427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.392707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.392964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.393230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.393500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.393772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.393947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.394115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.394310 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.394432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.394823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.395187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.395533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.395856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.396188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.396524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.396858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.397194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.397525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.420926 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.422512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.422794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.424333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.426552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.426933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.428657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.428942 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.429220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.432464 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.432824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.433165 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.436985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.437283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.440636 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.441034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.441805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.442098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.442380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.442659 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.442947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.443221 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.443490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.443756 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.446173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.446530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.446877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.447243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.447584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.447922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.448258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.448593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.462244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.462522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.467035 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.467263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.467603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.470618 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.470929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.472801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.476447 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.476575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.476861 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.480070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.481939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.484024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.484323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.484607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.484898 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.485180 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.485457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.486081 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.490309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.490685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.491058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.491404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.491742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.492087 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.505006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.505293 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.505559 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.505818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.511385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.511763 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.512100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.512434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.513832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.515531 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.515805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.519208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.519484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.519773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.520089 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.520385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.520763 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.522512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.522851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.525894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.526248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.526595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.526959 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.527316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.533451 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.533730 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.534005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.534280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.535110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.535413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.535705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.541448 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.541807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.542161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.542506 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.542847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.543214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.543563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.554151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.557454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.560701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.562275 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.565223 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.565502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.565813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.566627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.569821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.572974 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.573134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.574535 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.574679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.576175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.576440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.576711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.577761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.578052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.578336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.578611 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.686157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.687704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.688630 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.688934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.689220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.690834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.691152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.691422 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.691690 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.697007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.697286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.697561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.697834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.698101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.698369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.698812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.699106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.699378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.699649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.699925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.700185 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.700454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.700595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.700754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.700893 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.701138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.709452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:23:47.709727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.709998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.710260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.710524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.710783 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.711101 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.711362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.711623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.711988 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.712252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.712506 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.712769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.713038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:23:47.738698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633bb52a9c0 pid: 79326 (default app) Feb 28 10:23:47.742444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b77cb-babf-449e-9a24-39a4866851f3 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:47.742740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b77cb-babf-449e-9a24-39a4866851f3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:47.743041 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b77cb-babf-449e-9a24-39a4866851f3 None None] PATH_INFO: `/v3` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:47.748863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Mon Feb 28 10:23:47 2022] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:23:47.750326 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633bb52a9c0 pid: 79327 (default app) Feb 28 10:23:56.009967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46d85-f1cc-435f-b2f7-360fcb4f5f6f None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:56.010800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46d85-f1cc-435f-b2f7-360fcb4f5f6f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:56.010800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46d85-f1cc-435f-b2f7-360fcb4f5f6f None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:56.012862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:23:56.021001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac7f4a-d85f-4118-859c-1d1690bf213b None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:56.021424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac7f4a-d85f-4118-859c-1d1690bf213b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:56.021593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac7f4a-d85f-4118-859c-1d1690bf213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:56.051036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG oslo_db.sqlalchemy.engines [None req-2eac7f4a-d85f-4118-859c-1d1690bf213b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:23:56.234246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG passlib.handlers.bcrypt [None req-2eac7f4a-d85f-4118-859c-1d1690bf213b None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79327) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 28 10:23:56.234660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG passlib.handlers.bcrypt [None req-2eac7f4a-d85f-4118-859c-1d1690bf213b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79327) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 28 10:23:56.289655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-2eac7f4a-d85f-4118-859c-1d1690bf213b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:56.291209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-2eac7f4a-d85f-4118-859c-1d1690bf213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:56.409857 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1/3] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 28 10:23:56.541380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec46d85-f1cc-435f-b2f7-360fcb4f5f6f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:56.575060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG oslo_db.sqlalchemy.engines [None req-6ec46d85-f1cc-435f-b2f7-360fcb4f5f6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:23:56.700368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec46d85-f1cc-435f-b2f7-360fcb4f5f6f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:56.704608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947e94f-fc0e-4b49-9e8b-f9f4583b5732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:56.705249 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e94f-fc0e-4b49-9e8b-f9f4583b5732 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:56.705530 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e94f-fc0e-4b49-9e8b-f9f4583b5732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:56.705804 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e94f-fc0e-4b49-9e8b-f9f4583b5732 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:56.714184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947e94f-fc0e-4b49-9e8b-f9f4583b5732 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:56.766164 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2947e94f-fc0e-4b49-9e8b-f9f4583b5732 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 10:23:56.766508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947e94f-fc0e-4b49-9e8b-f9f4583b5732 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:56.775706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 3/4] 10.222.0.44 () {58 vars in 1324 bytes} [Mon Feb 28 10:23:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:23:56.781606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac7f4a-d85f-4118-859c-1d1690bf213b None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:56.795882 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac7f4a-d85f-4118-859c-1d1690bf213b None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:56.800799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb411d8f-42c9-4c37-a8ac-561287c36da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:56.801909 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb411d8f-42c9-4c37-a8ac-561287c36da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:56.802191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb411d8f-42c9-4c37-a8ac-561287c36da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:56.802465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb411d8f-42c9-4c37-a8ac-561287c36da5 admin admin] PATH_INFO: `/v3/projects/df99af6079f04b40ae2fb2b304eafd0e` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:56.804097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb411d8f-42c9-4c37-a8ac-561287c36da5 admin admin] RBAC: Authorizing `identity:get_project(project_id=df99af6079f04b40ae2fb2b304eafd0e)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:56.855029 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bb411d8f-42c9-4c37-a8ac-561287c36da5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 10:23:56.855374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb411d8f-42c9-4c37-a8ac-561287c36da5 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:56.859955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 2/5] 10.222.0.44 () {56 vars in 1207 bytes} [Mon Feb 28 10:23:56 2022] GET /identity/v3/projects/df99af6079f04b40ae2fb2b304eafd0e => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:23:59.096347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb078c9b-d1b7-48a7-a418-76a92c600fbd None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:59.096870 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb078c9b-d1b7-48a7-a418-76a92c600fbd None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:59.096964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb078c9b-d1b7-48a7-a418-76a92c600fbd None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:59.101522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 4/6] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:23:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:59.106876 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67260fd-b04e-4909-bade-f912c9b00283 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:59.107316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67260fd-b04e-4909-bade-f912c9b00283 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:59.107460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67260fd-b04e-4909-bade-f912c9b00283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:59.126813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c67260fd-b04e-4909-bade-f912c9b00283 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:59.129001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c67260fd-b04e-4909-bade-f912c9b00283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:59.137285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 3/7] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 28 10:23:59.159576 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb078c9b-d1b7-48a7-a418-76a92c600fbd None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:59.171625 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb078c9b-d1b7-48a7-a418-76a92c600fbd None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:59.176427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3403c-44a3-4bd4-8d22-44043f27dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:59.177056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3403c-44a3-4bd4-8d22-44043f27dc24 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:59.177342 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3403c-44a3-4bd4-8d22-44043f27dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:59.177622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3403c-44a3-4bd4-8d22-44043f27dc24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:59.185119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3403c-44a3-4bd4-8d22-44043f27dc24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:59.186895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3403c-44a3-4bd4-8d22-44043f27dc24 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:59.196104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 5/8] 10.222.0.44 () {58 vars in 1324 bytes} [Mon Feb 28 10:23:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:23:59.201190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67260fd-b04e-4909-bade-f912c9b00283 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:59.210016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67260fd-b04e-4909-bade-f912c9b00283 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:59.214357 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939c79a-4c6b-4d77-9f96-bd6730926cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:59.215236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939c79a-4c6b-4d77-9f96-bd6730926cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:59.215514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939c79a-4c6b-4d77-9f96-bd6730926cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:59.215787 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939c79a-4c6b-4d77-9f96-bd6730926cf2 admin admin] PATH_INFO: `/v3/users/870ce38416184f81819ea6b48f497b2a` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:59.217157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939c79a-4c6b-4d77-9f96-bd6730926cf2 admin admin] RBAC: Authorizing `identity:get_user(user_id=870ce38416184f81819ea6b48f497b2a)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:59.219014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939c79a-4c6b-4d77-9f96-bd6730926cf2 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:59.220544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 4/9] 10.222.0.44 () {56 vars in 1198 bytes} [Mon Feb 28 10:23:59 2022] GET /identity/v3/users/870ce38416184f81819ea6b48f497b2a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:01.562958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2e37-e2ec-4791-b31f-10b302ba2bb4 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:01.563490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2e37-e2ec-4791-b31f-10b302ba2bb4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:01.563490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2e37-e2ec-4791-b31f-10b302ba2bb4 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:01.565949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:01.570990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7445fd1-e6cb-4fc1-9fcb-deaf01c0cb70 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:01.571407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7445fd1-e6cb-4fc1-9fcb-deaf01c0cb70 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:01.571541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7445fd1-e6cb-4fc1-9fcb-deaf01c0cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:01.584908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead704-7c90-448a-a1a0-b1704bec276c None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:01.585191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead704-7c90-448a-a1a0-b1704bec276c None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:01.585466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead704-7c90-448a-a1a0-b1704bec276c None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:01.587239 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 7/11] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:24:01.588690 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c7445fd1-e6cb-4fc1-9fcb-deaf01c0cb70 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:01.589867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c7445fd1-e6cb-4fc1-9fcb-deaf01c0cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:01.592478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba45ad-32d6-4a7b-bbc7-60c436c04a92 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:01.592770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba45ad-32d6-4a7b-bbc7-60c436c04a92 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:01.593044 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba45ad-32d6-4a7b-bbc7-60c436c04a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:01.633337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG passlib.handlers.bcrypt [None req-bcba45ad-32d6-4a7b-bbc7-60c436c04a92 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79326) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 28 10:24:01.633753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG passlib.handlers.bcrypt [None req-bcba45ad-32d6-4a7b-bbc7-60c436c04a92 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79326) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 28 10:24:01.666464 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 5/12] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:01.680500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-bcba45ad-32d6-4a7b-bbc7-60c436c04a92 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:01.682368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-bcba45ad-32d6-4a7b-bbc7-60c436c04a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:01.689662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7445fd1-e6cb-4fc1-9fcb-deaf01c0cb70 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:01.778743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 8/13] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:01.784615 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7445fd1-e6cb-4fc1-9fcb-deaf01c0cb70 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:01.801170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba45ad-32d6-4a7b-bbc7-60c436c04a92 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:01.816523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de25157-8aa0-495d-87cf-88e44bafb200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:01.817248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25157-8aa0-495d-87cf-88e44bafb200 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:01.817526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25157-8aa0-495d-87cf-88e44bafb200 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:01.817799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25157-8aa0-495d-87cf-88e44bafb200 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:01.828415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de25157-8aa0-495d-87cf-88e44bafb200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:01.835774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-9de25157-8aa0-495d-87cf-88e44bafb200 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:24:01.836968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 6/14] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:24:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:24:01.842627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de25157-8aa0-495d-87cf-88e44bafb200 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:01.896524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba45ad-32d6-4a7b-bbc7-60c436c04a92 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:01.928524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb90210-4bbf-410c-b550-c76ee5a4f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:01.929391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb90210-4bbf-410c-b550-c76ee5a4f655 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:01.929680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb90210-4bbf-410c-b550-c76ee5a4f655 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:01.929954 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb90210-4bbf-410c-b550-c76ee5a4f655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:01.935062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de25157-8aa0-495d-87cf-88e44bafb200 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:01.968010 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a53b5c-7f59-4675-9485-0b7d3427dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:01.968657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a53b5c-7f59-4675-9485-0b7d3427dfac None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:01.968933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a53b5c-7f59-4675-9485-0b7d3427dfac None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:01.969203 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a53b5c-7f59-4675-9485-0b7d3427dfac None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:01.970011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a53b5c-7f59-4675-9485-0b7d3427dfac None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:01.970314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a53b5c-7f59-4675-9485-0b7d3427dfac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:01.971733 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a53b5c-7f59-4675-9485-0b7d3427dfac None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:01.982401 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 7/15] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:01.988292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a53b5c-7f59-4675-9485-0b7d3427dfac None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:01.994840 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb90210-4bbf-410c-b550-c76ee5a4f655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:01.996373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb90210-4bbf-410c-b550-c76ee5a4f655 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:02.083189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a53b5c-7f59-4675-9485-0b7d3427dfac None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:02.094691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 9/16] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:24:02.100365 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb90210-4bbf-410c-b550-c76ee5a4f655 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:02.113103 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea2fd9-d132-425d-bfab-c79a6808e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:02.113965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea2fd9-d132-425d-bfab-c79a6808e6ea None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:02.114240 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea2fd9-d132-425d-bfab-c79a6808e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:02.114507 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea2fd9-d132-425d-bfab-c79a6808e6ea None admin] PATH_INFO: `/v3/users/870ce38416184f81819ea6b48f497b2a` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:02.115735 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea2fd9-d132-425d-bfab-c79a6808e6ea None admin] RBAC: Authorizing `identity:get_user(user_id=870ce38416184f81819ea6b48f497b2a)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:02.117189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea2fd9-d132-425d-bfab-c79a6808e6ea None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:02.118791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 8/17] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:01 2022] GET /identity/v3/users/870ce38416184f81819ea6b48f497b2a => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:02.124199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea2fd9-d132-425d-bfab-c79a6808e6ea None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:02.193295 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb90210-4bbf-410c-b550-c76ee5a4f655 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:02.216385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea2fd9-d132-425d-bfab-c79a6808e6ea None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:02.224440 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7cfbc-4c4f-49fc-9bde-fab1e47eb0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:02.225223 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cfbc-4c4f-49fc-9bde-fab1e47eb0c6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:02.225504 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cfbc-4c4f-49fc-9bde-fab1e47eb0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:02.225780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cfbc-4c4f-49fc-9bde-fab1e47eb0c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:02.243941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7cfbc-4c4f-49fc-9bde-fab1e47eb0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:02.245408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7cfbc-4c4f-49fc-9bde-fab1e47eb0c6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:02.247711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbef16-652c-4594-b4e9-d984cc6fd0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:02.248473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbef16-652c-4594-b4e9-d984cc6fd0e9 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:02.248752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbef16-652c-4594-b4e9-d984cc6fd0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:02.249023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbef16-652c-4594-b4e9-d984cc6fd0e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:02.250182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbef16-652c-4594-b4e9-d984cc6fd0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:02.251634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbef16-652c-4594-b4e9-d984cc6fd0e9 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:02.253784 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 9/18] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:02.259338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbef16-652c-4594-b4e9-d984cc6fd0e9 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:02.262715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-09c7cfbc-4c4f-49fc-9bde-fab1e47eb0c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:24:02.263930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 10/19] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:24:02.269328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7cfbc-4c4f-49fc-9bde-fab1e47eb0c6 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:02.351444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbef16-652c-4594-b4e9-d984cc6fd0e9 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:02.361780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7cfbc-4c4f-49fc-9bde-fab1e47eb0c6 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:02.382991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f328fa-326d-4286-b94c-a4af51e024fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:02.383638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f328fa-326d-4286-b94c-a4af51e024fd None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:02.383918 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f328fa-326d-4286-b94c-a4af51e024fd None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:02.384192 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f328fa-326d-4286-b94c-a4af51e024fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:02.385006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f328fa-326d-4286-b94c-a4af51e024fd None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.domain.id=default, user.id=870ce38416184f81819ea6b48f497b2a) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:02.385312 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f328fa-326d-4286-b94c-a4af51e024fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:02.387052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f328fa-326d-4286-b94c-a4af51e024fd None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:02.393611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 10/20] 10.222.0.44 () {56 vars in 1322 bytes} [Mon Feb 28 10:24:02 2022] GET /identity/v3/role_assignments?user.id=870ce38416184f81819ea6b48f497b2a&scope.domain.id=default&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 233 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:02.393932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f62a-dc2f-4ec3-97d8-353b1c1568cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:02.394579 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f62a-dc2f-4ec3-97d8-353b1c1568cf None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:02.394859 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f62a-dc2f-4ec3-97d8-353b1c1568cf None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:02.395177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f62a-dc2f-4ec3-97d8-353b1c1568cf None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:02.395895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4f62a-dc2f-4ec3-97d8-353b1c1568cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:02.396200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4f62a-dc2f-4ec3-97d8-353b1c1568cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:02.397587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4f62a-dc2f-4ec3-97d8-353b1c1568cf None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:02.417368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 11/21] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:05.370314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9502b-0d7a-496c-a502-fc2ca3c428cc None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:05.371943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9502b-0d7a-496c-a502-fc2ca3c428cc None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:05.372751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9502b-0d7a-496c-a502-fc2ca3c428cc None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:05.377263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 11/22] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:05.383751 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb60ecb-b941-4a72-a007-0e568cc32664 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:05.384623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb60ecb-b941-4a72-a007-0e568cc32664 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:05.385103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb60ecb-b941-4a72-a007-0e568cc32664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:05.404552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-dbb60ecb-b941-4a72-a007-0e568cc32664 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:05.406081 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-dbb60ecb-b941-4a72-a007-0e568cc32664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:05.457122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054cac-1988-4ea9-bbdd-4ba8e9e838b8 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:05.457736 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054cac-1988-4ea9-bbdd-4ba8e9e838b8 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:05.458229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054cac-1988-4ea9-bbdd-4ba8e9e838b8 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:05.460515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 12/23] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:05.465453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a571e8-e8db-470c-a671-32d74172d198 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:05.465990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a571e8-e8db-470c-a671-32d74172d198 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:05.466461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a571e8-e8db-470c-a671-32d74172d198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:05.479367 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 12/24] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:05.495913 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a9a571e8-e8db-470c-a671-32d74172d198 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:05.497419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a9a571e8-e8db-470c-a671-32d74172d198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:05.502383 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb60ecb-b941-4a72-a007-0e568cc32664 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:05.598056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 13/25] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:05.601779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb60ecb-b941-4a72-a007-0e568cc32664 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:05.629117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f11290-cbb4-472e-a8b1-bf045591b54b None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:05.629691 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f11290-cbb4-472e-a8b1-bf045591b54b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:05.630162 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f11290-cbb4-472e-a8b1-bf045591b54b None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:05.632215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 14/26] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:24:05.633105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f11290-cbb4-472e-a8b1-bf045591b54b None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:05.636051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84cb0e-c7fd-415a-aa68-06efd7a57156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:05.636973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84cb0e-c7fd-415a-aa68-06efd7a57156 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:05.637518 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84cb0e-c7fd-415a-aa68-06efd7a57156 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:05.637983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84cb0e-c7fd-415a-aa68-06efd7a57156 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:05.638979 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84cb0e-c7fd-415a-aa68-06efd7a57156 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:05.640545 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84cb0e-c7fd-415a-aa68-06efd7a57156 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:05.780197 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f11290-cbb4-472e-a8b1-bf045591b54b None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:05.781170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 13/27] 10.222.0.44 () {60 vars in 1131 bytes} [Mon Feb 28 10:24:05 2022] POST /identity/v3/roles => generated 219 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:24:05.790931 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47522a-3b8f-47a4-8898-890d3284ceb5 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:05.791793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47522a-3b8f-47a4-8898-890d3284ceb5 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:05.792272 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47522a-3b8f-47a4-8898-890d3284ceb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:05.824128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-8d47522a-3b8f-47a4-8898-890d3284ceb5 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:05.826053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8d47522a-3b8f-47a4-8898-890d3284ceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:05.846746 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237271f-c820-422f-a85f-5e55449323ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:05.847588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237271f-c820-422f-a85f-5e55449323ce None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:05.847869 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237271f-c820-422f-a85f-5e55449323ce None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:05.848139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237271f-c820-422f-a85f-5e55449323ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:05.871260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237271f-c820-422f-a85f-5e55449323ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:05.872768 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237271f-c820-422f-a85f-5e55449323ce None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:05.893120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-7237271f-c820-422f-a85f-5e55449323ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:24:05.895251 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 15/28] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:05.908111 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237271f-c820-422f-a85f-5e55449323ce None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:05.963361 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 14/29] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:06.028057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47522a-3b8f-47a4-8898-890d3284ceb5 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:06.054303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237271f-c820-422f-a85f-5e55449323ce None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:06.097604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a809ba-079f-4396-aa3d-021e5d05427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:06.103542 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a809ba-079f-4396-aa3d-021e5d05427a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.103992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a809ba-079f-4396-aa3d-021e5d05427a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.104407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a809ba-079f-4396-aa3d-021e5d05427a None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.105609 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a809ba-079f-4396-aa3d-021e5d05427a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:06.106145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a809ba-079f-4396-aa3d-021e5d05427a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:06.108577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a809ba-079f-4396-aa3d-021e5d05427a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:06.154600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 16/30] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:06.160042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a809ba-079f-4396-aa3d-021e5d05427a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:06.178518 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47522a-3b8f-47a4-8898-890d3284ceb5 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:06.221654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5b1d4-a754-4039-bee9-f5b5f9f26b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:06.222459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b1d4-a754-4039-bee9-f5b5f9f26b93 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.222742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b1d4-a754-4039-bee9-f5b5f9f26b93 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.223046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b1d4-a754-4039-bee9-f5b5f9f26b93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.242185 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5b1d4-a754-4039-bee9-f5b5f9f26b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:06.253860 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-78b5b1d4-a754-4039-bee9-f5b5f9f26b93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:24:06.255490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 15/31] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:24:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:24:06.261337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5b1d4-a754-4039-bee9-f5b5f9f26b93 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:06.287981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a809ba-079f-4396-aa3d-021e5d05427a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:06.331777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc086dba-30e4-449e-a2f4-30c8e815f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:06.332749 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc086dba-30e4-449e-a2f4-30c8e815f3fa None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.333177 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc086dba-30e4-449e-a2f4-30c8e815f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.333612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc086dba-30e4-449e-a2f4-30c8e815f3fa None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.334499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc086dba-30e4-449e-a2f4-30c8e815f3fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:06.336204 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc086dba-30e4-449e-a2f4-30c8e815f3fa None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:06.390137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5b1d4-a754-4039-bee9-f5b5f9f26b93 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:06.434084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cc964-701b-49d0-bde0-81f20b474f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:06.435006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cc964-701b-49d0-bde0-81f20b474f9a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.435427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cc964-701b-49d0-bde0-81f20b474f9a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.435840 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cc964-701b-49d0-bde0-81f20b474f9a None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.436727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cc964-701b-49d0-bde0-81f20b474f9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:06.437205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cc964-701b-49d0-bde0-81f20b474f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:06.438895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cc964-701b-49d0-bde0-81f20b474f9a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:06.452979 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 16/32] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:06.454509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689f21c-6dd7-4492-a877-78f44a6fa417 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.455026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689f21c-6dd7-4492-a877-78f44a6fa417 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.455445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689f21c-6dd7-4492-a877-78f44a6fa417 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.458148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 17/33] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:06.462987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689f21c-6dd7-4492-a877-78f44a6fa417 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:06.509803 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 17/34] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:24:06 2022] POST /identity/v3/projects => generated 301 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:24:06.517806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea398-b209-4faa-a24e-05a0db0eae96 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.517806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea398-b209-4faa-a24e-05a0db0eae96 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.517806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea398-b209-4faa-a24e-05a0db0eae96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.540133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c35ea398-b209-4faa-a24e-05a0db0eae96 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:06.542689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c35ea398-b209-4faa-a24e-05a0db0eae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:06.575331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689f21c-6dd7-4492-a877-78f44a6fa417 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:06.614526 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdc0ce-be79-477f-b7e8-a36754d8864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:06.615542 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdc0ce-be79-477f-b7e8-a36754d8864f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.615828 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdc0ce-be79-477f-b7e8-a36754d8864f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.616107 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdc0ce-be79-477f-b7e8-a36754d8864f None admin] PATH_INFO: `/v3/users/870ce38416184f81819ea6b48f497b2a` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.617854 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdc0ce-be79-477f-b7e8-a36754d8864f None admin] RBAC: Authorizing `identity:get_user(user_id=870ce38416184f81819ea6b48f497b2a)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:06.619473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdc0ce-be79-477f-b7e8-a36754d8864f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:06.621220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 18/35] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:06 2022] GET /identity/v3/users/870ce38416184f81819ea6b48f497b2a => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:06.627240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320de4a9-1571-4103-9b7c-3cfce5c0b4a4 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.627569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320de4a9-1571-4103-9b7c-3cfce5c0b4a4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.627944 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320de4a9-1571-4103-9b7c-3cfce5c0b4a4 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.630165 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:06.631123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 18/37] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:06.635094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320de4a9-1571-4103-9b7c-3cfce5c0b4a4 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:06.636720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754af73c-33a2-43f6-b9fe-25a4ec5ab0c0 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.637005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754af73c-33a2-43f6-b9fe-25a4ec5ab0c0 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.637332 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754af73c-33a2-43f6-b9fe-25a4ec5ab0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.658338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-754af73c-33a2-43f6-b9fe-25a4ec5ab0c0 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:06.659851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-754af73c-33a2-43f6-b9fe-25a4ec5ab0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:06.745343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 19/38] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:06.747789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754af73c-33a2-43f6-b9fe-25a4ec5ab0c0 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:06.780624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320de4a9-1571-4103-9b7c-3cfce5c0b4a4 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:06.820305 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1e505-339f-4721-b316-246972fb64a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:06.821099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1e505-339f-4721-b316-246972fb64a0 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.821383 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1e505-339f-4721-b316-246972fb64a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.821661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1e505-339f-4721-b316-246972fb64a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.822839 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1e505-339f-4721-b316-246972fb64a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:06.824331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1e505-339f-4721-b316-246972fb64a0 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:06.825933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 20/39] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:06.827130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c15cb-98f2-476f-8627-9d3d0ba4de6b None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.827428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c15cb-98f2-476f-8627-9d3d0ba4de6b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.827693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c15cb-98f2-476f-8627-9d3d0ba4de6b None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.829439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 21/40] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:06.832256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c15cb-98f2-476f-8627-9d3d0ba4de6b None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:06.863999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754af73c-33a2-43f6-b9fe-25a4ec5ab0c0 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:06.896290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df04fb-c071-4685-a841-50b4944efbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:06.896952 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df04fb-c071-4685-a841-50b4944efbe0 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.897232 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df04fb-c071-4685-a841-50b4944efbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.897503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df04fb-c071-4685-a841-50b4944efbe0 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.898231 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df04fb-c071-4685-a841-50b4944efbe0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:06.899769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df04fb-c071-4685-a841-50b4944efbe0 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:06.916246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1131 bytes} [Mon Feb 28 10:24:06 2022] POST /identity/v3/roles => generated 225 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:24:06.917025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df04fb-c071-4685-a841-50b4944efbe0 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:06.931894 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c15cb-98f2-476f-8627-9d3d0ba4de6b None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:06.969459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce644d8-59b9-4480-b0f6-7d80345e32da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:06.970139 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce644d8-59b9-4480-b0f6-7d80345e32da None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.970428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce644d8-59b9-4480-b0f6-7d80345e32da None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.970693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce644d8-59b9-4480-b0f6-7d80345e32da None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.972000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce644d8-59b9-4480-b0f6-7d80345e32da None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:06.973843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce644d8-59b9-4480-b0f6-7d80345e32da None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:06.994948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1131 bytes} [Mon Feb 28 10:24:06 2022] POST /identity/v3/roles => generated 223 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:24:06.994948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf148b45-bdac-4dbf-9b85-ec91362efc97 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.994948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf148b45-bdac-4dbf-9b85-ec91362efc97 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.994948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf148b45-bdac-4dbf-9b85-ec91362efc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:07.016697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-cf148b45-bdac-4dbf-9b85-ec91362efc97 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:07.017977 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cf148b45-bdac-4dbf-9b85-ec91362efc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:07.055505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df04fb-c071-4685-a841-50b4944efbe0 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:07.101318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 23/43] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:07.106834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf098578-cf1e-4049-9f6d-79ddeff48fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:07.107913 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf098578-cf1e-4049-9f6d-79ddeff48fb9 None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:07.108297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf098578-cf1e-4049-9f6d-79ddeff48fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:07.108654 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf098578-cf1e-4049-9f6d-79ddeff48fb9 None admin] PATH_INFO: `/v3/domains/default/users/870ce38416184f81819ea6b48f497b2a/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:07.110961 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf098578-cf1e-4049-9f6d-79ddeff48fb9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=870ce38416184f81819ea6b48f497b2a, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:07.112642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf098578-cf1e-4049-9f6d-79ddeff48fb9 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:07.133066 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 21/44] 10.222.0.44 () {58 vars in 1361 bytes} [Mon Feb 28 10:24:06 2022] PUT /identity/v3/domains/default/users/870ce38416184f81819ea6b48f497b2a/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:24:07.149874 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf148b45-bdac-4dbf-9b85-ec91362efc97 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:07.269864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf148b45-bdac-4dbf-9b85-ec91362efc97 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:07.305353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3cf6e-2cda-48f7-a234-569e1e4be043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:07.306163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3cf6e-2cda-48f7-a234-569e1e4be043 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:07.306454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3cf6e-2cda-48f7-a234-569e1e4be043 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:07.306734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3cf6e-2cda-48f7-a234-569e1e4be043 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:07.307988 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3cf6e-2cda-48f7-a234-569e1e4be043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:07.309468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3cf6e-2cda-48f7-a234-569e1e4be043 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:07.311145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 24/45] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:07.317593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf098578-cf1e-4049-9f6d-79ddeff48fb9 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:07.415857 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf098578-cf1e-4049-9f6d-79ddeff48fb9 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:07.449057 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e1dff-7937-4c3a-939e-0aa8b26b7d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:07.450054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e1dff-7937-4c3a-939e-0aa8b26b7d03 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:07.450481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e1dff-7937-4c3a-939e-0aa8b26b7d03 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:07.450912 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e1dff-7937-4c3a-939e-0aa8b26b7d03 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:07.452039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e1dff-7937-4c3a-939e-0aa8b26b7d03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:07.454315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e1dff-7937-4c3a-939e-0aa8b26b7d03 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:07.498939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 22/46] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:24:07 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:24:09.429270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3cfc-2f73-48c6-96a9-b5e0f4a95aec None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:09.429815 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3cfc-2f73-48c6-96a9-b5e0f4a95aec None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:09.429815 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3cfc-2f73-48c6-96a9-b5e0f4a95aec None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:09.431622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 25/47] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:09.436917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a439-54ce-40d3-9bc6-7ebaa2a06fab None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:09.437323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a439-54ce-40d3-9bc6-7ebaa2a06fab None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:09.437478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a439-54ce-40d3-9bc6-7ebaa2a06fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:09.454497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-3d97a439-54ce-40d3-9bc6-7ebaa2a06fab None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:09.455709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3d97a439-54ce-40d3-9bc6-7ebaa2a06fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:09.519828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 23/48] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:09.543060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd3cfc-2f73-48c6-96a9-b5e0f4a95aec None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:09.639418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd3cfc-2f73-48c6-96a9-b5e0f4a95aec None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:09.670861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f289-4cdb-4046-a7e5-24fa8c597ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:09.671667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f289-4cdb-4046-a7e5-24fa8c597ad6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:09.671951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f289-4cdb-4046-a7e5-24fa8c597ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:09.672227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f289-4cdb-4046-a7e5-24fa8c597ad6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:09.682766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74f289-4cdb-4046-a7e5-24fa8c597ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:09.689457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-4a74f289-4cdb-4046-a7e5-24fa8c597ad6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:24:09.691215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 26/49] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:24:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:09.697217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97a439-54ce-40d3-9bc6-7ebaa2a06fab None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:09.759226 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0f4da-fefe-4d77-9c8e-b1400d507038 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:09.759623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0f4da-fefe-4d77-9c8e-b1400d507038 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:09.759993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0f4da-fefe-4d77-9c8e-b1400d507038 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:09.762025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 27/50] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:24:09.766951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d24b5-6901-4ee0-b788-77f1cf5bfcd4 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:09.767249 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d24b5-6901-4ee0-b788-77f1cf5bfcd4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:09.767534 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d24b5-6901-4ee0-b788-77f1cf5bfcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:09.784519 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-250d24b5-6901-4ee0-b788-77f1cf5bfcd4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:09.785692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-250d24b5-6901-4ee0-b788-77f1cf5bfcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:09.792132 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97a439-54ce-40d3-9bc6-7ebaa2a06fab None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:09.825247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2961b4-402e-4c71-8777-5eb8fe02b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:09.825920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2961b4-402e-4c71-8777-5eb8fe02b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:09.826206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2961b4-402e-4c71-8777-5eb8fe02b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:09.826479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2961b4-402e-4c71-8777-5eb8fe02b4d2 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:09.827262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2961b4-402e-4c71-8777-5eb8fe02b4d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:09.827571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2961b4-402e-4c71-8777-5eb8fe02b4d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:09.828957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2961b4-402e-4c71-8777-5eb8fe02b4d2 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:09.837022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 24/51] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:09.842583 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2961b4-402e-4c71-8777-5eb8fe02b4d2 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:09.849635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 28/52] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:09.873332 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d24b5-6901-4ee0-b788-77f1cf5bfcd4 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:09.936060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2961b4-402e-4c71-8777-5eb8fe02b4d2 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:09.969057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d24b5-6901-4ee0-b788-77f1cf5bfcd4 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:09.970420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4df2c-b437-4355-89e0-28bf7a08847d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:09.971320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4df2c-b437-4355-89e0-28bf7a08847d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:09.971603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4df2c-b437-4355-89e0-28bf7a08847d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:09.971878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4df2c-b437-4355-89e0-28bf7a08847d None admin] PATH_INFO: `/v3/users/870ce38416184f81819ea6b48f497b2a` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:09.973077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4df2c-b437-4355-89e0-28bf7a08847d None admin] RBAC: Authorizing `identity:get_user(user_id=870ce38416184f81819ea6b48f497b2a)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:09.974511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4df2c-b437-4355-89e0-28bf7a08847d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:09.976147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 25/53] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:09 2022] GET /identity/v3/users/870ce38416184f81819ea6b48f497b2a => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:09.981656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4df2c-b437-4355-89e0-28bf7a08847d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:10.001759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81302338-cc77-4cf9-9e74-25a0bb5ae68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:10.003107 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302338-cc77-4cf9-9e74-25a0bb5ae68c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:10.003394 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302338-cc77-4cf9-9e74-25a0bb5ae68c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:10.003674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302338-cc77-4cf9-9e74-25a0bb5ae68c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:10.004854 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302338-cc77-4cf9-9e74-25a0bb5ae68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:10.006303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302338-cc77-4cf9-9e74-25a0bb5ae68c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:10.007924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 29/54] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:10.013486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81302338-cc77-4cf9-9e74-25a0bb5ae68c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:10.075578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4df2c-b437-4355-89e0-28bf7a08847d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:10.107149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81302338-cc77-4cf9-9e74-25a0bb5ae68c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:10.108143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c0875-b6a4-466b-ba4e-cb32e7ce8f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:10.109012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c0875-b6a4-466b-ba4e-cb32e7ce8f90 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:10.109368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c0875-b6a4-466b-ba4e-cb32e7ce8f90 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:10.109710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c0875-b6a4-466b-ba4e-cb32e7ce8f90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:10.111047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c0875-b6a4-466b-ba4e-cb32e7ce8f90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:10.113127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c0875-b6a4-466b-ba4e-cb32e7ce8f90 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:10.114764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 26/55] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:10.120520 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c0875-b6a4-466b-ba4e-cb32e7ce8f90 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:10.140552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4697a-150e-4486-8193-de91a13370ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:10.141316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4697a-150e-4486-8193-de91a13370ca None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:10.141609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4697a-150e-4486-8193-de91a13370ca None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:10.141888 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4697a-150e-4486-8193-de91a13370ca None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:10.142595 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4697a-150e-4486-8193-de91a13370ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:10.144593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4697a-150e-4486-8193-de91a13370ca None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:10.171683 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 30/56] 10.222.0.44 () {60 vars in 1140 bytes} [Mon Feb 28 10:24:10 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:24:10.220198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c0875-b6a4-466b-ba4e-cb32e7ce8f90 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:10.254695 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb19d9-48dd-48b8-9371-695e5519e908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:10.255392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb19d9-48dd-48b8-9371-695e5519e908 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:10.255676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb19d9-48dd-48b8-9371-695e5519e908 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:10.255950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb19d9-48dd-48b8-9371-695e5519e908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:10.256783 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb19d9-48dd-48b8-9371-695e5519e908 None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.domain.id=default, user.id=870ce38416184f81819ea6b48f497b2a) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:10.257093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb19d9-48dd-48b8-9371-695e5519e908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:10.258560 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb19d9-48dd-48b8-9371-695e5519e908 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:10.265172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 27/57] 10.222.0.44 () {56 vars in 1322 bytes} [Mon Feb 28 10:24:10 2022] GET /identity/v3/role_assignments?user.id=870ce38416184f81819ea6b48f497b2a&scope.domain.id=default&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:12.503107 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6f6e-5d6d-420e-bc21-1aa8be9a0210 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:12.503622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6f6e-5d6d-420e-bc21-1aa8be9a0210 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:12.503764 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6f6e-5d6d-420e-bc21-1aa8be9a0210 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:12.505436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 31/58] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:12.510815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef47ce-54ca-46d8-afed-c421711969ff None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:12.511212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef47ce-54ca-46d8-afed-c421711969ff None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:12.511405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef47ce-54ca-46d8-afed-c421711969ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:12.527955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a8ef47ce-54ca-46d8-afed-c421711969ff None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:12.529151 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a8ef47ce-54ca-46d8-afed-c421711969ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:12.592382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 28/59] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:12.617400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b6f6e-5d6d-420e-bc21-1aa8be9a0210 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:12.723896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b6f6e-5d6d-420e-bc21-1aa8be9a0210 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:12.763510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23acce-395f-4c62-b44b-3ade22f446d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:12.764662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23acce-395f-4c62-b44b-3ade22f446d2 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:12.765097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23acce-395f-4c62-b44b-3ade22f446d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:12.765536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23acce-395f-4c62-b44b-3ade22f446d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:12.767103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23acce-395f-4c62-b44b-3ade22f446d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:12.768644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23acce-395f-4c62-b44b-3ade22f446d2 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:12.770259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 32/60] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:12.776669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef47ce-54ca-46d8-afed-c421711969ff None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:12.881665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef47ce-54ca-46d8-afed-c421711969ff None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:12.915733 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d3250-1875-422a-995f-01e3d47a74de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:12.916402 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3250-1875-422a-995f-01e3d47a74de None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:12.916687 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3250-1875-422a-995f-01e3d47a74de None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:12.916965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3250-1875-422a-995f-01e3d47a74de None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:12.917686 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d3250-1875-422a-995f-01e3d47a74de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:12.919172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d3250-1875-422a-995f-01e3d47a74de None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:12.949617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 29/61] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:24:12 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:24:16.491486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e2861-d578-4c92-b016-994efa7a6ae4 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.492495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e2861-d578-4c92-b016-994efa7a6ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.492987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e2861-d578-4c92-b016-994efa7a6ae4 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.495286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 33/62] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:16.500764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba2a1-2a08-483b-832c-6c45b4eb4d6d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.501160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba2a1-2a08-483b-832c-6c45b4eb4d6d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.501322 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba2a1-2a08-483b-832c-6c45b4eb4d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.523216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-792ba2a1-2a08-483b-832c-6c45b4eb4d6d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:16.524397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-792ba2a1-2a08-483b-832c-6c45b4eb4d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:16.581896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb196c1-b972-431c-b8eb-66c069f878c4 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.582535 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb196c1-b972-431c-b8eb-66c069f878c4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.583068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb196c1-b972-431c-b8eb-66c069f878c4 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.585047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 34/63] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:24:16.590546 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea89ed-62c2-41a6-8971-0ed976f18b2b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.591154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea89ed-62c2-41a6-8971-0ed976f18b2b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.591653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea89ed-62c2-41a6-8971-0ed976f18b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.608336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 30/64] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:16.619911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-a5ea89ed-62c2-41a6-8971-0ed976f18b2b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:16.621410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a5ea89ed-62c2-41a6-8971-0ed976f18b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:16.649667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32c1ce-a6b1-4c42-a717-f734af9d1068 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.649667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32c1ce-a6b1-4c42-a717-f734af9d1068 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.650032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32c1ce-a6b1-4c42-a717-f734af9d1068 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.652069 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 31/65] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:16.657117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4668-5d9f-4f61-b1ce-1277250e533c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.657405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4668-5d9f-4f61-b1ce-1277250e533c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.657680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4668-5d9f-4f61-b1ce-1277250e533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.677993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-24eb4668-5d9f-4f61-b1ce-1277250e533c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:16.679512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-24eb4668-5d9f-4f61-b1ce-1277250e533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:16.708205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 35/66] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:16.709083 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea89ed-62c2-41a6-8971-0ed976f18b2b None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:16.753905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 32/67] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:16.756102 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b6485-0388-4307-871d-0bc4e0112dff None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.756867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b6485-0388-4307-871d-0bc4e0112dff None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.757350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b6485-0388-4307-871d-0bc4e0112dff None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.760009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 33/68] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:16.761184 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b6485-0388-4307-871d-0bc4e0112dff None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:16.812276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea89ed-62c2-41a6-8971-0ed976f18b2b None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:16.847299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a4e46-3322-4992-b62e-6e6d8e1e5e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:16.848397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a4e46-3322-4992-b62e-6e6d8e1e5e35 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.848681 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a4e46-3322-4992-b62e-6e6d8e1e5e35 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.849093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a4e46-3322-4992-b62e-6e6d8e1e5e35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.859836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a4e46-3322-4992-b62e-6e6d8e1e5e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:16.867341 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-662a4e46-3322-4992-b62e-6e6d8e1e5e35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:16.873339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 36/69] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:16.873490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b6485-0388-4307-871d-0bc4e0112dff None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:16.873587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22882989-6029-46b8-a074-0ad43144a618 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.873587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22882989-6029-46b8-a074-0ad43144a618 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.873587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22882989-6029-46b8-a074-0ad43144a618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.886575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-22882989-6029-46b8-a074-0ad43144a618 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:16.887807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-22882989-6029-46b8-a074-0ad43144a618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:16.906582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c8ea8-2a4b-446b-a8cf-5fc2defe7582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:16.907406 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c8ea8-2a4b-446b-a8cf-5fc2defe7582 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.907677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c8ea8-2a4b-446b-a8cf-5fc2defe7582 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.907942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c8ea8-2a4b-446b-a8cf-5fc2defe7582 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.918294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c8ea8-2a4b-446b-a8cf-5fc2defe7582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:16.925104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-607c8ea8-2a4b-446b-a8cf-5fc2defe7582 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:24:16.931386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 34/70] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:16.931386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c8ea8-2a4b-446b-a8cf-5fc2defe7582 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:16.958257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 37/71] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:16.964221 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22882989-6029-46b8-a074-0ad43144a618 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:17.033359 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c8ea8-2a4b-446b-a8cf-5fc2defe7582 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:17.063500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22882989-6029-46b8-a074-0ad43144a618 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:17.066258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1e08a-e3e4-4d11-a078-dd58730ac97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:17.067073 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1e08a-e3e4-4d11-a078-dd58730ac97d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.067353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1e08a-e3e4-4d11-a078-dd58730ac97d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.067622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1e08a-e3e4-4d11-a078-dd58730ac97d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.078410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1e08a-e3e4-4d11-a078-dd58730ac97d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:17.087069 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-f8d1e08a-e3e4-4d11-a078-dd58730ac97d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:17.091034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 35/72] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:17.092072 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1e08a-e3e4-4d11-a078-dd58730ac97d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:17.101564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffd540-b394-4166-9399-3d2a7a8bd1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:17.102427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffd540-b394-4166-9399-3d2a7a8bd1e7 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.102858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffd540-b394-4166-9399-3d2a7a8bd1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.103345 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffd540-b394-4166-9399-3d2a7a8bd1e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.104098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffd540-b394-4166-9399-3d2a7a8bd1e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:17.104410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffd540-b394-4166-9399-3d2a7a8bd1e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:17.105782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffd540-b394-4166-9399-3d2a7a8bd1e7 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:17.114446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 38/73] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:17.119424 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffd540-b394-4166-9399-3d2a7a8bd1e7 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:17.190629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1e08a-e3e4-4d11-a078-dd58730ac97d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:17.222640 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78f3f1-bd64-4dea-8871-7fe092f5b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:17.223247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffd540-b394-4166-9399-3d2a7a8bd1e7 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:17.223348 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78f3f1-bd64-4dea-8871-7fe092f5b11e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.223600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78f3f1-bd64-4dea-8871-7fe092f5b11e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.223872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78f3f1-bd64-4dea-8871-7fe092f5b11e None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.224610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78f3f1-bd64-4dea-8871-7fe092f5b11e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:17.224910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78f3f1-bd64-4dea-8871-7fe092f5b11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:17.226298 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78f3f1-bd64-4dea-8871-7fe092f5b11e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:17.233951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 36/74] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:17.234728 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78f3f1-bd64-4dea-8871-7fe092f5b11e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:17.259947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229aaf7-f1c8-4d3e-b39b-0fcd4429b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:17.261007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229aaf7-f1c8-4d3e-b39b-0fcd4429b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.261291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229aaf7-f1c8-4d3e-b39b-0fcd4429b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.261569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229aaf7-f1c8-4d3e-b39b-0fcd4429b9a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.271222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229aaf7-f1c8-4d3e-b39b-0fcd4429b9a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:17.278409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-2229aaf7-f1c8-4d3e-b39b-0fcd4429b9a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:24:17.279609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 39/75] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:24:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:17.280437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229aaf7-f1c8-4d3e-b39b-0fcd4429b9a5 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:17.329980 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78f3f1-bd64-4dea-8871-7fe092f5b11e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:17.361182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d3a26-91c5-4bfb-b145-1ab521290aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:17.362433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d3a26-91c5-4bfb-b145-1ab521290aed None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.362709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d3a26-91c5-4bfb-b145-1ab521290aed None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.363007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d3a26-91c5-4bfb-b145-1ab521290aed None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.363741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d3a26-91c5-4bfb-b145-1ab521290aed None admin] RBAC: Adding query filter params (name=member) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:17.364043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d3a26-91c5-4bfb-b145-1ab521290aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:17.365420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d3a26-91c5-4bfb-b145-1ab521290aed None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:17.373261 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 37/76] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:17.373715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229aaf7-f1c8-4d3e-b39b-0fcd4429b9a5 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:17.374312 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e22d84-4165-4fc7-895a-14518234cdb5 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.374597 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e22d84-4165-4fc7-895a-14518234cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.374870 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e22d84-4165-4fc7-895a-14518234cdb5 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.376667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 38/77] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:17.377288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e22d84-4165-4fc7-895a-14518234cdb5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:17.405732 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4aa82e-4eec-4f10-b230-f32484d6b465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:17.406586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aa82e-4eec-4f10-b230-f32484d6b465 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.406871 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aa82e-4eec-4f10-b230-f32484d6b465 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.407181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aa82e-4eec-4f10-b230-f32484d6b465 None admin] PATH_INFO: `/v3/users/48947de8105644d9bd2143a64e99e110` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.421930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4aa82e-4eec-4f10-b230-f32484d6b465 None admin] RBAC: Authorizing `identity:get_user(user_id=48947de8105644d9bd2143a64e99e110)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:17.423406 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4aa82e-4eec-4f10-b230-f32484d6b465 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:17.425105 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 40/78] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:17 2022] GET /identity/v3/users/48947de8105644d9bd2143a64e99e110 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:17.425870 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4aa82e-4eec-4f10-b230-f32484d6b465 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:17.472283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e22d84-4165-4fc7-895a-14518234cdb5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:17.503507 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f4b4-734e-4fb4-ba2d-8ca3e1357521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:17.504357 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f4b4-734e-4fb4-ba2d-8ca3e1357521 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.504634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f4b4-734e-4fb4-ba2d-8ca3e1357521 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.504906 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f4b4-734e-4fb4-ba2d-8ca3e1357521 None admin] PATH_INFO: `/v3/users/870ce38416184f81819ea6b48f497b2a` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.506079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0f4b4-734e-4fb4-ba2d-8ca3e1357521 None admin] RBAC: Authorizing `identity:get_user(user_id=870ce38416184f81819ea6b48f497b2a)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:17.507538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0f4b4-734e-4fb4-ba2d-8ca3e1357521 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:17.509127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 39/79] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:17 2022] GET /identity/v3/users/870ce38416184f81819ea6b48f497b2a => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:17.509910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f4b4-734e-4fb4-ba2d-8ca3e1357521 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:17.519052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4aa82e-4eec-4f10-b230-f32484d6b465 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:17.551219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c904e0-7a2b-47c0-9080-eb63001589a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:17.551874 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c904e0-7a2b-47c0-9080-eb63001589a1 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.552158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c904e0-7a2b-47c0-9080-eb63001589a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.552437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c904e0-7a2b-47c0-9080-eb63001589a1 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.553177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c904e0-7a2b-47c0-9080-eb63001589a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:17.553484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c904e0-7a2b-47c0-9080-eb63001589a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:17.554854 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c904e0-7a2b-47c0-9080-eb63001589a1 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:17.562424 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 41/80] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:24:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:17.563637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb407d-3042-4527-881e-85d13147bf74 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.563925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb407d-3042-4527-881e-85d13147bf74 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.564204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb407d-3042-4527-881e-85d13147bf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.582347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-adcb407d-3042-4527-881e-85d13147bf74 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:17.583492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-adcb407d-3042-4527-881e-85d13147bf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:17.611323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f4b4-734e-4fb4-ba2d-8ca3e1357521 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:17.644013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06429dab-e1e8-455b-9a34-559e6c4136f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:17.644874 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429dab-e1e8-455b-9a34-559e6c4136f6 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.645156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429dab-e1e8-455b-9a34-559e6c4136f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.645430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429dab-e1e8-455b-9a34-559e6c4136f6 None admin] PATH_INFO: `/v3/users/48947de8105644d9bd2143a64e99e110` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.646626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06429dab-e1e8-455b-9a34-559e6c4136f6 None admin] RBAC: Authorizing `identity:get_user(user_id=48947de8105644d9bd2143a64e99e110)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:17.647720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 42/81] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:17.648125 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06429dab-e1e8-455b-9a34-559e6c4136f6 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:17.648562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb407d-3042-4527-881e-85d13147bf74 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:17.654074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 40/82] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:17 2022] GET /identity/v3/users/48947de8105644d9bd2143a64e99e110 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:17.654074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06429dab-e1e8-455b-9a34-559e6c4136f6 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:17.741248 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb407d-3042-4527-881e-85d13147bf74 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:17.752925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06429dab-e1e8-455b-9a34-559e6c4136f6 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:17.774402 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7ef9d-fa02-42e3-a725-13ce13d751f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:17.775076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7ef9d-fa02-42e3-a725-13ce13d751f1 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.775360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7ef9d-fa02-42e3-a725-13ce13d751f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.775633 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7ef9d-fa02-42e3-a725-13ce13d751f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.784536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30feb8-ed56-4057-90a5-6962a0e3dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:17.785175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30feb8-ed56-4057-90a5-6962a0e3dff8 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:17.785465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30feb8-ed56-4057-90a5-6962a0e3dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:17.785740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30feb8-ed56-4057-90a5-6962a0e3dff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:17.838141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7ef9d-fa02-42e3-a725-13ce13d751f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:17.839567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7ef9d-fa02-42e3-a725-13ce13d751f1 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:17.849362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30feb8-ed56-4057-90a5-6962a0e3dff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:17.850829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30feb8-ed56-4057-90a5-6962a0e3dff8 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:17.940266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 43/83] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:17.941109 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7ef9d-fa02-42e3-a725-13ce13d751f1 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:17.945160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 41/84] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:17.945160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30feb8-ed56-4057-90a5-6962a0e3dff8 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.034655 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7ef9d-fa02-42e3-a725-13ce13d751f1 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.036606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30feb8-ed56-4057-90a5-6962a0e3dff8 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.066450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ff292-a4a3-48f4-9c2d-80fb69efc3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.067323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff292-a4a3-48f4-9c2d-80fb69efc3cd None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.067603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff292-a4a3-48f4-9c2d-80fb69efc3cd None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.067877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff292-a4a3-48f4-9c2d-80fb69efc3cd None admin] PATH_INFO: `/v3/users/48947de8105644d9bd2143a64e99e110` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.068618 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e222bfb-41e3-44a2-afa5-03161f18e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.069044 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ff292-a4a3-48f4-9c2d-80fb69efc3cd None admin] RBAC: Authorizing `identity:get_user(user_id=48947de8105644d9bd2143a64e99e110)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.069257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e222bfb-41e3-44a2-afa5-03161f18e040 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.069540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e222bfb-41e3-44a2-afa5-03161f18e040 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.069814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e222bfb-41e3-44a2-afa5-03161f18e040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.070480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ff292-a4a3-48f4-9c2d-80fb69efc3cd None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.072101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 44/85] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:17 2022] GET /identity/v3/users/48947de8105644d9bd2143a64e99e110 => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:18.072848 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ff292-a4a3-48f4-9c2d-80fb69efc3cd None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.134948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e222bfb-41e3-44a2-afa5-03161f18e040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.136682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e222bfb-41e3-44a2-afa5-03161f18e040 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.165993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ff292-a4a3-48f4-9c2d-80fb69efc3cd None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.198734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8272fd-e622-4a9c-b179-878da8f69b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.199531 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8272fd-e622-4a9c-b179-878da8f69b47 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.199812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8272fd-e622-4a9c-b179-878da8f69b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.200087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8272fd-e622-4a9c-b179-878da8f69b47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.201254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8272fd-e622-4a9c-b179-878da8f69b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.202656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8272fd-e622-4a9c-b179-878da8f69b47 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.204263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 45/86] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:18.205019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8272fd-e622-4a9c-b179-878da8f69b47 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.229067 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 42/87] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:18.229885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e222bfb-41e3-44a2-afa5-03161f18e040 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.301031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8272fd-e622-4a9c-b179-878da8f69b47 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.321124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e222bfb-41e3-44a2-afa5-03161f18e040 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.333133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aa986-0886-48e2-b1d7-d805365fbf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.333968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aa986-0886-48e2-b1d7-d805365fbf56 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.334246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aa986-0886-48e2-b1d7-d805365fbf56 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.334515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aa986-0886-48e2-b1d7-d805365fbf56 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.335712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aa986-0886-48e2-b1d7-d805365fbf56 None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.337140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aa986-0886-48e2-b1d7-d805365fbf56 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.338779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 46/88] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:18 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:18.339561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aa986-0886-48e2-b1d7-d805365fbf56 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.353286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6223db-a000-4c3d-8bb1-bde904bdda75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.354135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6223db-a000-4c3d-8bb1-bde904bdda75 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.354417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6223db-a000-4c3d-8bb1-bde904bdda75 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.354692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6223db-a000-4c3d-8bb1-bde904bdda75 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.355899 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6223db-a000-4c3d-8bb1-bde904bdda75 None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.357342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6223db-a000-4c3d-8bb1-bde904bdda75 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.359168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 43/89] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:18 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:18.359793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6223db-a000-4c3d-8bb1-bde904bdda75 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.431770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aa986-0886-48e2-b1d7-d805365fbf56 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.451395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6223db-a000-4c3d-8bb1-bde904bdda75 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.463572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f03730-0610-4b30-9050-3285ba3472a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.464206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03730-0610-4b30-9050-3285ba3472a8 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.464486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03730-0610-4b30-9050-3285ba3472a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.464766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03730-0610-4b30-9050-3285ba3472a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.483249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c5ac-7382-4a53-97a7-ee489ec11f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.483899 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c5ac-7382-4a53-97a7-ee489ec11f2c None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.484182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c5ac-7382-4a53-97a7-ee489ec11f2c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.484458 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c5ac-7382-4a53-97a7-ee489ec11f2c None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.485167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0c5ac-7382-4a53-97a7-ee489ec11f2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.487165 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0c5ac-7382-4a53-97a7-ee489ec11f2c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.504983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 44/90] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:24:18 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:24:18.505783 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c5ac-7382-4a53-97a7-ee489ec11f2c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.534196 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f03730-0610-4b30-9050-3285ba3472a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.535793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f03730-0610-4b30-9050-3285ba3472a8 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.609948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c5ac-7382-4a53-97a7-ee489ec11f2c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.638374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 47/91] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:18.639671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f03730-0610-4b30-9050-3285ba3472a8 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.645274 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c766-8ca6-462d-aaba-908f7280e4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.646145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c766-8ca6-462d-aaba-908f7280e4da None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.646424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c766-8ca6-462d-aaba-908f7280e4da None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.646696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c766-8ca6-462d-aaba-908f7280e4da None admin] PATH_INFO: `/v3/projects/d0f534ff485043a9befb2523d64f8ad5` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.647938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055c766-8ca6-462d-aaba-908f7280e4da None admin] RBAC: Authorizing `identity:get_project(project_id=d0f534ff485043a9befb2523d64f8ad5)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.649418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055c766-8ca6-462d-aaba-908f7280e4da None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.651228 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 45/92] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:18 2022] GET /identity/v3/projects/d0f534ff485043a9befb2523d64f8ad5 => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:18.652109 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c766-8ca6-462d-aaba-908f7280e4da None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.741447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f03730-0610-4b30-9050-3285ba3472a8 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.755067 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c766-8ca6-462d-aaba-908f7280e4da None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.778303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814cee8-ae0b-4137-8aa2-77fd99e21933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.779338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814cee8-ae0b-4137-8aa2-77fd99e21933 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.779831 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814cee8-ae0b-4137-8aa2-77fd99e21933 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.780332 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814cee8-ae0b-4137-8aa2-77fd99e21933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.781400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814cee8-ae0b-4137-8aa2-77fd99e21933 None admin] RBAC: Adding query filter params (role.id=f8641f824b324fa2956c5fc5b764f8ae, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb, user.id=48947de8105644d9bd2143a64e99e110) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:18.781938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814cee8-ae0b-4137-8aa2-77fd99e21933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.784157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814cee8-ae0b-4137-8aa2-77fd99e21933 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.791714 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722307f-ae49-4312-99f0-090019cea4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.792380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722307f-ae49-4312-99f0-090019cea4f7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.792663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722307f-ae49-4312-99f0-090019cea4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.792942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722307f-ae49-4312-99f0-090019cea4f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.793780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722307f-ae49-4312-99f0-090019cea4f7 None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb, user.id=870ce38416184f81819ea6b48f497b2a) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:18.793880 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 48/93] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:18 2022] GET /identity/v3/role_assignments?user.id=48947de8105644d9bd2143a64e99e110&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:18.794094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722307f-ae49-4312-99f0-090019cea4f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.794639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814cee8-ae0b-4137-8aa2-77fd99e21933 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.795738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722307f-ae49-4312-99f0-090019cea4f7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.806203 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 46/94] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:18 2022] GET /identity/v3/role_assignments?user.id=870ce38416184f81819ea6b48f497b2a&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:18.806887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722307f-ae49-4312-99f0-090019cea4f7 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.911253 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814cee8-ae0b-4137-8aa2-77fd99e21933 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.920716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722307f-ae49-4312-99f0-090019cea4f7 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:18.949837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8667d6f-8944-41b5-9886-877f123216fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.951140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667d6f-8944-41b5-9886-877f123216fe None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.951664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667d6f-8944-41b5-9886-877f123216fe None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.952259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667d6f-8944-41b5-9886-877f123216fe None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.954040 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8667d6f-8944-41b5-9886-877f123216fe None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.956317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8667d6f-8944-41b5-9886-877f123216fe None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.958199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b226cd-13f9-4433-8ba4-b2052effaf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:18.958868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b226cd-13f9-4433-8ba4-b2052effaf8d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:18.959182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b226cd-13f9-4433-8ba4-b2052effaf8d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:18.959459 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b226cd-13f9-4433-8ba4-b2052effaf8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:18.959657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 49/95] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:18 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:18.963007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b226cd-13f9-4433-8ba4-b2052effaf8d None admin] RBAC: Adding query filter params (role.id=f8641f824b324fa2956c5fc5b764f8ae, scope.project.id=d0f534ff485043a9befb2523d64f8ad5, user.id=48947de8105644d9bd2143a64e99e110) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:18.963007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b226cd-13f9-4433-8ba4-b2052effaf8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:18.963007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b226cd-13f9-4433-8ba4-b2052effaf8d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:18.965520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8667d6f-8944-41b5-9886-877f123216fe None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:18.968494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 47/96] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:18 2022] GET /identity/v3/role_assignments?user.id=48947de8105644d9bd2143a64e99e110&scope.project.id=d0f534ff485043a9befb2523d64f8ad5&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:19.082726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8667d6f-8944-41b5-9886-877f123216fe None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:19.121106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c059f1-e7a2-4fcb-8ce9-975a07321dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:19.121778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c059f1-e7a2-4fcb-8ce9-975a07321dc5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:19.122068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c059f1-e7a2-4fcb-8ce9-975a07321dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:19.122349 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c059f1-e7a2-4fcb-8ce9-975a07321dc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:19.123230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c059f1-e7a2-4fcb-8ce9-975a07321dc5 None admin] RBAC: Adding query filter params (role.id=79396755fc0842a882775515d6feab13, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb, user.id=48947de8105644d9bd2143a64e99e110) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:19.123551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c059f1-e7a2-4fcb-8ce9-975a07321dc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:19.125066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c059f1-e7a2-4fcb-8ce9-975a07321dc5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:19.131818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 50/97] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:18 2022] GET /identity/v3/role_assignments?user.id=48947de8105644d9bd2143a64e99e110&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=79396755fc0842a882775515d6feab13 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:21.659009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b347-183a-476d-8eb5-4e9dac3021f1 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:21.659996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b347-183a-476d-8eb5-4e9dac3021f1 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:21.660483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b347-183a-476d-8eb5-4e9dac3021f1 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:21.662489 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 48/98] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:21.668002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130c662-ec07-45e3-b006-7dd2d97206c9 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:21.668866 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130c662-ec07-45e3-b006-7dd2d97206c9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:21.669507 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130c662-ec07-45e3-b006-7dd2d97206c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:21.695866 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f130c662-ec07-45e3-b006-7dd2d97206c9 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:21.697339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f130c662-ec07-45e3-b006-7dd2d97206c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:21.779046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 51/99] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:21.808390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa2d0-f83c-47b1-8c57-b6e4f511af77 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:21.809002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa2d0-f83c-47b1-8c57-b6e4f511af77 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:21.809536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa2d0-f83c-47b1-8c57-b6e4f511af77 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:21.810428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130c662-ec07-45e3-b006-7dd2d97206c9 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:21.811752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 49/100] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:21.817728 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ec9f1-9bda-47e7-a060-4d14fd04ce6d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:21.818263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ec9f1-9bda-47e7-a060-4d14fd04ce6d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:21.818734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ec9f1-9bda-47e7-a060-4d14fd04ce6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:21.847941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-605ec9f1-9bda-47e7-a060-4d14fd04ce6d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:21.849471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-605ec9f1-9bda-47e7-a060-4d14fd04ce6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:21.954247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 50/101] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:21.988456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ec9f1-9bda-47e7-a060-4d14fd04ce6d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:21.994635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130c662-ec07-45e3-b006-7dd2d97206c9 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:22.076159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb494a2-f4bb-4b78-a477-da239b021996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:22.076967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb494a2-f4bb-4b78-a477-da239b021996 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.077252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb494a2-f4bb-4b78-a477-da239b021996 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.077528 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb494a2-f4bb-4b78-a477-da239b021996 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.104292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb494a2-f4bb-4b78-a477-da239b021996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:22.113843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ec9f1-9bda-47e7-a060-4d14fd04ce6d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:22.119586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-0cb494a2-f4bb-4b78-a477-da239b021996 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:24:22.120884 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 52/102] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:24:22.122350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d705cb-1576-4f9b-93fa-629e765f8874 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.122638 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d705cb-1576-4f9b-93fa-629e765f8874 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.123063 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d705cb-1576-4f9b-93fa-629e765f8874 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.124757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 53/103] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:22.134629 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d705cb-1576-4f9b-93fa-629e765f8874 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:22.163711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efee32-4e07-4921-a311-0c079047acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:22.164758 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efee32-4e07-4921-a311-0c079047acf7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.165043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efee32-4e07-4921-a311-0c079047acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.165318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efee32-4e07-4921-a311-0c079047acf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.169214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efee32-4e07-4921-a311-0c079047acf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:22.170833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efee32-4e07-4921-a311-0c079047acf7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:22.172508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 51/104] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:22.173693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faff3e-f22a-409f-b7df-b03c5182fe2e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.174027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faff3e-f22a-409f-b7df-b03c5182fe2e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.174303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faff3e-f22a-409f-b7df-b03c5182fe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.213053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-03faff3e-f22a-409f-b7df-b03c5182fe2e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:22.214160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-03faff3e-f22a-409f-b7df-b03c5182fe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:22.284832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d705cb-1576-4f9b-93fa-629e765f8874 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:22.333813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a05b46-b882-45ec-ac18-0db52a0d8fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:22.334497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a05b46-b882-45ec-ac18-0db52a0d8fe5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.334780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a05b46-b882-45ec-ac18-0db52a0d8fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.335091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a05b46-b882-45ec-ac18-0db52a0d8fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.335843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a05b46-b882-45ec-ac18-0db52a0d8fe5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:22.336153 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a05b46-b882-45ec-ac18-0db52a0d8fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:22.337548 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a05b46-b882-45ec-ac18-0db52a0d8fe5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:22.347159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 54/105] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:22.348245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a05b46-b882-45ec-ac18-0db52a0d8fe5 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:22.349362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 52/106] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:22.356466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faff3e-f22a-409f-b7df-b03c5182fe2e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:22.460680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a05b46-b882-45ec-ac18-0db52a0d8fe5 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:22.476726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faff3e-f22a-409f-b7df-b03c5182fe2e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:22.505466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d229c25-cece-48e2-91da-4c617fbf5b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:22.506138 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d229c25-cece-48e2-91da-4c617fbf5b9e None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.506426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d229c25-cece-48e2-91da-4c617fbf5b9e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.506705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d229c25-cece-48e2-91da-4c617fbf5b9e None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.507470 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d229c25-cece-48e2-91da-4c617fbf5b9e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:22.508901 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d229c25-cece-48e2-91da-4c617fbf5b9e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:22.522042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc3ac4-a983-4b96-9042-c6894b6a1c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:22.522949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3ac4-a983-4b96-9042-c6894b6a1c9d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.523230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3ac4-a983-4b96-9042-c6894b6a1c9d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.523503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3ac4-a983-4b96-9042-c6894b6a1c9d None admin] PATH_INFO: `/v3/users/69fe978b74134375b981ad69574fe05b` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.544461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc3ac4-a983-4b96-9042-c6894b6a1c9d None admin] RBAC: Authorizing `identity:get_user(user_id=69fe978b74134375b981ad69574fe05b)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:22.553552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc3ac4-a983-4b96-9042-c6894b6a1c9d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:22.557251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 55/107] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:24:22 2022] POST /identity/v3/projects => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:24:22.557972 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d229c25-cece-48e2-91da-4c617fbf5b9e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:22.558834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 53/108] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:22 2022] GET /identity/v3/users/69fe978b74134375b981ad69574fe05b => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:22.566084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc3ac4-a983-4b96-9042-c6894b6a1c9d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:22.711274 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d229c25-cece-48e2-91da-4c617fbf5b9e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:22.756989 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc3ac4-a983-4b96-9042-c6894b6a1c9d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:22.795684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15bfd0-a110-4c54-9051-25444aa557da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:22.796370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b32a2a-c123-4c67-a15e-1d7b473e0ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:22.796939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bfd0-a110-4c54-9051-25444aa557da None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.797067 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32a2a-c123-4c67-a15e-1d7b473e0ad4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.797290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32a2a-c123-4c67-a15e-1d7b473e0ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.797563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32a2a-c123-4c67-a15e-1d7b473e0ad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.797765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bfd0-a110-4c54-9051-25444aa557da None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.798171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bfd0-a110-4c54-9051-25444aa557da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.811705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15bfd0-a110-4c54-9051-25444aa557da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:22.819478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-fd15bfd0-a110-4c54-9051-25444aa557da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:24:22.820889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 56/109] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:22.824475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad750f-ff77-4ada-a36a-bcc9788a3633 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.824983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad750f-ff77-4ada-a36a-bcc9788a3633 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.825464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad750f-ff77-4ada-a36a-bcc9788a3633 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.832024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 57/110] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:22.833896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc5f3-16b9-4710-b5ea-ac57635f5227 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.834400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc5f3-16b9-4710-b5ea-ac57635f5227 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.834880 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc5f3-16b9-4710-b5ea-ac57635f5227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.856983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-1e7bc5f3-16b9-4710-b5ea-ac57635f5227 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:22.858500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-1e7bc5f3-16b9-4710-b5ea-ac57635f5227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:22.874248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b32a2a-c123-4c67-a15e-1d7b473e0ad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:22.875762 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b32a2a-c123-4c67-a15e-1d7b473e0ad4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:22.935239 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 58/111] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:22.936994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4158b7-4f99-46ad-b62f-288942c02a21 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.937455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4158b7-4f99-46ad-b62f-288942c02a21 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.937891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4158b7-4f99-46ad-b62f-288942c02a21 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.940322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 59/112] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:22.941193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4158b7-4f99-46ad-b62f-288942c02a21 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:22.994439 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 54/113] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:22.996154 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ad109-0ebf-465c-9e97-307aed7bae91 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.996670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ad109-0ebf-465c-9e97-307aed7bae91 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.997152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ad109-0ebf-465c-9e97-307aed7bae91 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.999309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 55/114] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:23.000596 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d8ff8-d93a-4ddb-9168-3c2c06fc555d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.001098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d8ff8-d93a-4ddb-9168-3c2c06fc555d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.001588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d8ff8-d93a-4ddb-9168-3c2c06fc555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.019015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-6a0d8ff8-d93a-4ddb-9168-3c2c06fc555d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:23.020393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6a0d8ff8-d93a-4ddb-9168-3c2c06fc555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:23.047599 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4158b7-4f99-46ad-b62f-288942c02a21 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:23.087216 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb57b7-7f81-46dd-95ac-60f15b85ae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:23.087925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb57b7-7f81-46dd-95ac-60f15b85ae92 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.088214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb57b7-7f81-46dd-95ac-60f15b85ae92 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.088498 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb57b7-7f81-46dd-95ac-60f15b85ae92 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.089253 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb57b7-7f81-46dd-95ac-60f15b85ae92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:23.089567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb57b7-7f81-46dd-95ac-60f15b85ae92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:23.090970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb57b7-7f81-46dd-95ac-60f15b85ae92 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:23.104117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 60/115] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:23.104298 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 56/116] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:23.104391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb57b7-7f81-46dd-95ac-60f15b85ae92 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:23.104480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d8ff8-d93a-4ddb-9168-3c2c06fc555d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:23.201260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb57b7-7f81-46dd-95ac-60f15b85ae92 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:23.202496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d8ff8-d93a-4ddb-9168-3c2c06fc555d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:23.233651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ad205-bebb-4ce9-81de-daf7eb014c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:23.234542 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ad205-bebb-4ce9-81de-daf7eb014c76 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.234825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ad205-bebb-4ce9-81de-daf7eb014c76 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.235128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ad205-bebb-4ce9-81de-daf7eb014c76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.235374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0438-6e99-4989-86ba-21f96d0c5def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:23.236220 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0438-6e99-4989-86ba-21f96d0c5def None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.237041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0438-6e99-4989-86ba-21f96d0c5def None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.237321 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0438-6e99-4989-86ba-21f96d0c5def None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.238487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a0438-6e99-4989-86ba-21f96d0c5def None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:23.239974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a0438-6e99-4989-86ba-21f96d0c5def None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:23.246457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 57/117] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:23 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:23.246457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cbc38-d2ec-49ff-9311-faac289cb2a3 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.246457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cbc38-d2ec-49ff-9311-faac289cb2a3 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.246457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cbc38-d2ec-49ff-9311-faac289cb2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.250550 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ad205-bebb-4ce9-81de-daf7eb014c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:23.258637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-9d6ad205-bebb-4ce9-81de-daf7eb014c76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:24:23.259844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 61/118] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:24:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:23.261360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e22cbc38-d2ec-49ff-9311-faac289cb2a3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:23.262532 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e22cbc38-d2ec-49ff-9311-faac289cb2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:23.263787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ad205-bebb-4ce9-81de-daf7eb014c76 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:23.335002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 58/119] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:23.335002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cbc38-d2ec-49ff-9311-faac289cb2a3 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:23.372410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ad205-bebb-4ce9-81de-daf7eb014c76 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:23.405179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c7405-0da2-44c2-b902-ecffcc5e9cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:23.406141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c7405-0da2-44c2-b902-ecffcc5e9cbb None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.406447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c7405-0da2-44c2-b902-ecffcc5e9cbb None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.406724 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c7405-0da2-44c2-b902-ecffcc5e9cbb None admin] PATH_INFO: `/v3/users/870ce38416184f81819ea6b48f497b2a` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.407966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c7405-0da2-44c2-b902-ecffcc5e9cbb None admin] RBAC: Authorizing `identity:get_user(user_id=870ce38416184f81819ea6b48f497b2a)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:23.409465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c7405-0da2-44c2-b902-ecffcc5e9cbb None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:23.411408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 62/120] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:23 2022] GET /identity/v3/users/870ce38416184f81819ea6b48f497b2a => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:23.412189 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c7405-0da2-44c2-b902-ecffcc5e9cbb None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:23.433124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cbc38-d2ec-49ff-9311-faac289cb2a3 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:23.466140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db807531-996f-45bd-9c05-2366f9a256de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:23.467263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db807531-996f-45bd-9c05-2366f9a256de None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.467681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db807531-996f-45bd-9c05-2366f9a256de None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.468106 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db807531-996f-45bd-9c05-2366f9a256de None admin] PATH_INFO: `/v3/roles/member` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.482350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db807531-996f-45bd-9c05-2366f9a256de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:23.489983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-db807531-996f-45bd-9c05-2366f9a256de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:23.491693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 59/121] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:23.492627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db807531-996f-45bd-9c05-2366f9a256de None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:23.524804 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c7405-0da2-44c2-b902-ecffcc5e9cbb None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:23.558267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7203bf9-7c0e-4519-b656-be1b7eeeb06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:23.558944 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7203bf9-7c0e-4519-b656-be1b7eeeb06d None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.559239 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7203bf9-7c0e-4519-b656-be1b7eeeb06d None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.559544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7203bf9-7c0e-4519-b656-be1b7eeeb06d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.560740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7203bf9-7c0e-4519-b656-be1b7eeeb06d None admin] RBAC: Adding query filter params (role.id=1b0597a6df10450bb5b56ed2c8b6261d, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb, user.id=69fe978b74134375b981ad69574fe05b) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:23.560740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7203bf9-7c0e-4519-b656-be1b7eeeb06d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:23.562083 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7203bf9-7c0e-4519-b656-be1b7eeeb06d None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:23.575229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 63/122] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:23 2022] GET /identity/v3/role_assignments?user.id=69fe978b74134375b981ad69574fe05b&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=1b0597a6df10450bb5b56ed2c8b6261d => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:23.575229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7203bf9-7c0e-4519-b656-be1b7eeeb06d None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:23.603317 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db807531-996f-45bd-9c05-2366f9a256de None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:23.641062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e1996-78f4-46cf-919f-34716b0db0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:23.641726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e1996-78f4-46cf-919f-34716b0db0ec None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.642005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e1996-78f4-46cf-919f-34716b0db0ec None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.642277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e1996-78f4-46cf-919f-34716b0db0ec None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.643692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e1996-78f4-46cf-919f-34716b0db0ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:23.644036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e1996-78f4-46cf-919f-34716b0db0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:23.645494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e1996-78f4-46cf-919f-34716b0db0ec None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:23.654744 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 60/123] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:24:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:23.659977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e1996-78f4-46cf-919f-34716b0db0ec None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:23.697770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7203bf9-7c0e-4519-b656-be1b7eeeb06d None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:23.733330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca43e8c-c5ac-47b4-81e8-dd9d38b13385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:23.734829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca43e8c-c5ac-47b4-81e8-dd9d38b13385 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.735276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca43e8c-c5ac-47b4-81e8-dd9d38b13385 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.735720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca43e8c-c5ac-47b4-81e8-dd9d38b13385 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.747775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca43e8c-c5ac-47b4-81e8-dd9d38b13385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:23.755199 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-fca43e8c-c5ac-47b4-81e8-dd9d38b13385 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:23.756928 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 64/124] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:23.757958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca43e8c-c5ac-47b4-81e8-dd9d38b13385 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:23.768356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e1996-78f4-46cf-919f-34716b0db0ec None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:23.802036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8637c0-ff64-46ea-894c-ec2f54f5ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:23.802892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8637c0-ff64-46ea-894c-ec2f54f5ee89 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.803196 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8637c0-ff64-46ea-894c-ec2f54f5ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.803468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8637c0-ff64-46ea-894c-ec2f54f5ee89 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.804660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8637c0-ff64-46ea-894c-ec2f54f5ee89 None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:23.806138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8637c0-ff64-46ea-894c-ec2f54f5ee89 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:23.808174 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 61/125] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:23 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:23.812779 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8637c0-ff64-46ea-894c-ec2f54f5ee89 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:23.867103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca43e8c-c5ac-47b4-81e8-dd9d38b13385 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:23.900958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16873e8-5691-4644-9cec-7a5dda6c3671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:23.902013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16873e8-5691-4644-9cec-7a5dda6c3671 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.902518 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16873e8-5691-4644-9cec-7a5dda6c3671 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.903024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16873e8-5691-4644-9cec-7a5dda6c3671 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.903968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16873e8-5691-4644-9cec-7a5dda6c3671 None admin] RBAC: Adding query filter params (name=member) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:23.904515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16873e8-5691-4644-9cec-7a5dda6c3671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:23.906155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16873e8-5691-4644-9cec-7a5dda6c3671 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:23.913802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8637c0-ff64-46ea-894c-ec2f54f5ee89 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:23.915986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 65/126] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:23.917053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16873e8-5691-4644-9cec-7a5dda6c3671 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:23.953964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f8ebf-74db-44f9-92e5-712fdab32600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:23.954841 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8ebf-74db-44f9-92e5-712fdab32600 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:23.955922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8ebf-74db-44f9-92e5-712fdab32600 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:23.956355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8ebf-74db-44f9-92e5-712fdab32600 None admin] PATH_INFO: `/v3/users/48947de8105644d9bd2143a64e99e110` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:23.958230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f8ebf-74db-44f9-92e5-712fdab32600 None admin] RBAC: Authorizing `identity:get_user(user_id=48947de8105644d9bd2143a64e99e110)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:23.959891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f8ebf-74db-44f9-92e5-712fdab32600 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:23.961724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 62/127] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:23 2022] GET /identity/v3/users/48947de8105644d9bd2143a64e99e110 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:23.964309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f8ebf-74db-44f9-92e5-712fdab32600 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:24.039098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16873e8-5691-4644-9cec-7a5dda6c3671 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:24.067347 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f8ebf-74db-44f9-92e5-712fdab32600 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:24.071274 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a6df3-58e3-41f6-abe4-b1504846865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:24.072187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a6df3-58e3-41f6-abe4-b1504846865e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.072672 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a6df3-58e3-41f6-abe4-b1504846865e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.073168 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a6df3-58e3-41f6-abe4-b1504846865e None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.074094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a6df3-58e3-41f6-abe4-b1504846865e None admin] RBAC: Adding query filter params (name=member) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:24.074601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a6df3-58e3-41f6-abe4-b1504846865e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:24.076194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a6df3-58e3-41f6-abe4-b1504846865e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:24.096268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 66/128] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:24.097119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a6df3-58e3-41f6-abe4-b1504846865e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:24.105515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13773715-689f-44f1-bf8c-0cff65d6b526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:24.106452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13773715-689f-44f1-bf8c-0cff65d6b526 None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.106736 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13773715-689f-44f1-bf8c-0cff65d6b526 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.107310 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13773715-689f-44f1-bf8c-0cff65d6b526 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/users/870ce38416184f81819ea6b48f497b2a/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.109403 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13773715-689f-44f1-bf8c-0cff65d6b526 None admin] RBAC: Authorizing `identity:create_grant(project_id=c72151b764de430b89f44fcf9d7e9dbb, user_id=870ce38416184f81819ea6b48f497b2a, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:24.110835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13773715-689f-44f1-bf8c-0cff65d6b526 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:24.125119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 63/129] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:24:23 2022] PUT /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/users/870ce38416184f81819ea6b48f497b2a/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:24:24.126436 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13773715-689f-44f1-bf8c-0cff65d6b526 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:24.223533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a6df3-58e3-41f6-abe4-b1504846865e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:24.255170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13773715-689f-44f1-bf8c-0cff65d6b526 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:24.277900 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4237363-54ba-40a3-8814-4fdffca0bd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:24.278786 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4237363-54ba-40a3-8814-4fdffca0bd43 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.279102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4237363-54ba-40a3-8814-4fdffca0bd43 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.279379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4237363-54ba-40a3-8814-4fdffca0bd43 None admin] PATH_INFO: `/v3/users/48947de8105644d9bd2143a64e99e110` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.281952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4237363-54ba-40a3-8814-4fdffca0bd43 None admin] RBAC: Authorizing `identity:get_user(user_id=48947de8105644d9bd2143a64e99e110)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:24.285013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4237363-54ba-40a3-8814-4fdffca0bd43 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:24.290162 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 67/130] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:24 2022] GET /identity/v3/users/48947de8105644d9bd2143a64e99e110 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:24.291130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4237363-54ba-40a3-8814-4fdffca0bd43 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:24.324022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcaffb-7f85-4645-b37a-68038dee5c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:24.324906 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcaffb-7f85-4645-b37a-68038dee5c0a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.325188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcaffb-7f85-4645-b37a-68038dee5c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.325517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcaffb-7f85-4645-b37a-68038dee5c0a None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.327071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcaffb-7f85-4645-b37a-68038dee5c0a None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:24.328557 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcaffb-7f85-4645-b37a-68038dee5c0a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:24.332541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 64/131] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:24 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:24.338062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcaffb-7f85-4645-b37a-68038dee5c0a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:24.458052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4237363-54ba-40a3-8814-4fdffca0bd43 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:24.480643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcaffb-7f85-4645-b37a-68038dee5c0a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:24.499449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ab4f7-1458-477d-b0dd-1b02504039b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:24.500336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab4f7-1458-477d-b0dd-1b02504039b5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.500614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab4f7-1458-477d-b0dd-1b02504039b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.500887 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab4f7-1458-477d-b0dd-1b02504039b5 None admin] PATH_INFO: `/v3/users/48947de8105644d9bd2143a64e99e110` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.502680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ab4f7-1458-477d-b0dd-1b02504039b5 None admin] RBAC: Authorizing `identity:get_user(user_id=48947de8105644d9bd2143a64e99e110)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:24.504359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ab4f7-1458-477d-b0dd-1b02504039b5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:24.505989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 68/132] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:24 2022] GET /identity/v3/users/48947de8105644d9bd2143a64e99e110 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:24.512981 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ab4f7-1458-477d-b0dd-1b02504039b5 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:24.537845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672390c-5999-4af2-901b-ded79965610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:24.539095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672390c-5999-4af2-901b-ded79965610a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.539573 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672390c-5999-4af2-901b-ded79965610a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.540060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672390c-5999-4af2-901b-ded79965610a None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.541416 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672390c-5999-4af2-901b-ded79965610a None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:24.543119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672390c-5999-4af2-901b-ded79965610a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:24.545012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 65/133] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:24 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:24.550925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672390c-5999-4af2-901b-ded79965610a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:24.660074 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ab4f7-1458-477d-b0dd-1b02504039b5 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:24.731567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a8b85-3420-4c76-8427-884c61ba0a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:24.732431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a8b85-3420-4c76-8427-884c61ba0a32 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.732718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a8b85-3420-4c76-8427-884c61ba0a32 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.732990 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a8b85-3420-4c76-8427-884c61ba0a32 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/users/48947de8105644d9bd2143a64e99e110/roles/79396755fc0842a882775515d6feab13` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.738121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a8b85-3420-4c76-8427-884c61ba0a32 None admin] RBAC: Authorizing `identity:create_grant(project_id=c72151b764de430b89f44fcf9d7e9dbb, user_id=48947de8105644d9bd2143a64e99e110, role_id=79396755fc0842a882775515d6feab13)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:24.739588 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a8b85-3420-4c76-8427-884c61ba0a32 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:24.746652 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672390c-5999-4af2-901b-ded79965610a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:24.762404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 69/134] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:24:24 2022] PUT /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/users/48947de8105644d9bd2143a64e99e110/roles/79396755fc0842a882775515d6feab13 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:24:24.772351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a8b85-3420-4c76-8427-884c61ba0a32 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:24.848655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7df17-d8a6-4950-be2f-f6c746541cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:24.850236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7df17-d8a6-4950-be2f-f6c746541cda None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.850710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7df17-d8a6-4950-be2f-f6c746541cda None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.851197 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7df17-d8a6-4950-be2f-f6c746541cda None admin] PATH_INFO: `/v3/projects/d0f534ff485043a9befb2523d64f8ad5` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.852570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7df17-d8a6-4950-be2f-f6c746541cda None admin] RBAC: Authorizing `identity:get_project(project_id=d0f534ff485043a9befb2523d64f8ad5)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:24.854209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7df17-d8a6-4950-be2f-f6c746541cda None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:24.864444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 66/135] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:24 2022] GET /identity/v3/projects/d0f534ff485043a9befb2523d64f8ad5 => generated 312 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:24.870456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7df17-d8a6-4950-be2f-f6c746541cda None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:24.987460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a8b85-3420-4c76-8427-884c61ba0a32 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:25.029487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7df17-d8a6-4950-be2f-f6c746541cda None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:25.031618 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2069d37-9316-4970-a5c3-aa1c4c2fba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:25.032876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2069d37-9316-4970-a5c3-aa1c4c2fba49 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:25.032876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2069d37-9316-4970-a5c3-aa1c4c2fba49 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:25.033038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2069d37-9316-4970-a5c3-aa1c4c2fba49 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/users/48947de8105644d9bd2143a64e99e110/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:25.035989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2069d37-9316-4970-a5c3-aa1c4c2fba49 None admin] RBAC: Authorizing `identity:create_grant(project_id=c72151b764de430b89f44fcf9d7e9dbb, user_id=48947de8105644d9bd2143a64e99e110, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:25.037463 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2069d37-9316-4970-a5c3-aa1c4c2fba49 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:25.062655 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 70/136] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:24:24 2022] PUT /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/users/48947de8105644d9bd2143a64e99e110/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:24:25.067224 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462e6c0-205f-4079-8b09-bbffa592b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:25.068473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462e6c0-205f-4079-8b09-bbffa592b9bf None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:25.068957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462e6c0-205f-4079-8b09-bbffa592b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:25.069452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462e6c0-205f-4079-8b09-bbffa592b9bf None admin] PATH_INFO: `/v3/projects/d0f534ff485043a9befb2523d64f8ad5/users/48947de8105644d9bd2143a64e99e110/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:25.071919 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462e6c0-205f-4079-8b09-bbffa592b9bf None admin] RBAC: Authorizing `identity:create_grant(project_id=d0f534ff485043a9befb2523d64f8ad5, user_id=48947de8105644d9bd2143a64e99e110, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:25.073710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462e6c0-205f-4079-8b09-bbffa592b9bf None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:25.102268 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 67/137] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:24:24 2022] PUT /identity/v3/projects/d0f534ff485043a9befb2523d64f8ad5/users/48947de8105644d9bd2143a64e99e110/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:24:25.225609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e96cc-c35a-4aae-b15b-f7e9164725f8 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:25.225936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e96cc-c35a-4aae-b15b-f7e9164725f8 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:25.226199 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e96cc-c35a-4aae-b15b-f7e9164725f8 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:25.228140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 71/138] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:25.234108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dc214-4a80-4aa0-bb74-ac42e2b5c595 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:25.234749 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dc214-4a80-4aa0-bb74-ac42e2b5c595 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:25.235258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dc214-4a80-4aa0-bb74-ac42e2b5c595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:25.260254 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-269dc214-4a80-4aa0-bb74-ac42e2b5c595 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:25.261672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-269dc214-4a80-4aa0-bb74-ac42e2b5c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:25.344924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 68/139] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:25.381906 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e96cc-c35a-4aae-b15b-f7e9164725f8 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:25.511447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e96cc-c35a-4aae-b15b-f7e9164725f8 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:25.557201 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1350f17-69ba-47c6-afb7-9d3d44c623f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:25.558018 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1350f17-69ba-47c6-afb7-9d3d44c623f5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:25.558300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1350f17-69ba-47c6-afb7-9d3d44c623f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:25.558575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1350f17-69ba-47c6-afb7-9d3d44c623f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:25.559837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1350f17-69ba-47c6-afb7-9d3d44c623f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:25.561390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1350f17-69ba-47c6-afb7-9d3d44c623f5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:25.563481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 72/140] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:25.569273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dc214-4a80-4aa0-bb74-ac42e2b5c595 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:25.721794 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dc214-4a80-4aa0-bb74-ac42e2b5c595 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:25.762118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c557dba-2e61-429f-b621-15850c66e652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:25.762713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557dba-2e61-429f-b621-15850c66e652 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:25.763019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557dba-2e61-429f-b621-15850c66e652 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:25.763294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557dba-2e61-429f-b621-15850c66e652 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:25.764007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c557dba-2e61-429f-b621-15850c66e652 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:25.765446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c557dba-2e61-429f-b621-15850c66e652 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:25.794983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 69/141] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:24:25 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:24:26.886544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d128e7d-f324-4f66-acf4-f0d2fb803659 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:26.887087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d128e7d-f324-4f66-acf4-f0d2fb803659 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:26.887087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d128e7d-f324-4f66-acf4-f0d2fb803659 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:26.889041 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 73/142] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:26.894752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed84f-971d-49d6-9cbf-9c06151d35cd None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:26.895261 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed84f-971d-49d6-9cbf-9c06151d35cd None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:26.895418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed84f-971d-49d6-9cbf-9c06151d35cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:26.919880 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e36ed84f-971d-49d6-9cbf-9c06151d35cd None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:26.921063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e36ed84f-971d-49d6-9cbf-9c06151d35cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:27.005471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 70/143] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:27.039631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d128e7d-f324-4f66-acf4-f0d2fb803659 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:27.178291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d128e7d-f324-4f66-acf4-f0d2fb803659 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:27.216423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33cbe0-ef33-46ce-be7d-10ba0030ed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:27.217210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33cbe0-ef33-46ce-be7d-10ba0030ed27 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:27.217491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33cbe0-ef33-46ce-be7d-10ba0030ed27 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:27.217825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33cbe0-ef33-46ce-be7d-10ba0030ed27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:27.230877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33cbe0-ef33-46ce-be7d-10ba0030ed27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:27.237915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-4a33cbe0-ef33-46ce-be7d-10ba0030ed27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:24:27.241639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 74/144] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:27.247706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ed84f-971d-49d6-9cbf-9c06151d35cd None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:27.365871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ed84f-971d-49d6-9cbf-9c06151d35cd None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:27.406283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eace4-b2e7-4d87-a533-1380eb7652a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:27.406975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eace4-b2e7-4d87-a533-1380eb7652a3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:27.407256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eace4-b2e7-4d87-a533-1380eb7652a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:27.407529 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eace4-b2e7-4d87-a533-1380eb7652a3 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:27.408376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eace4-b2e7-4d87-a533-1380eb7652a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:27.408680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eace4-b2e7-4d87-a533-1380eb7652a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:27.410124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eace4-b2e7-4d87-a533-1380eb7652a3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:27.418716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 71/145] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:27.425149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33cbe0-ef33-46ce-be7d-10ba0030ed27 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:27.527464 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174f64-8668-42b5-82f9-5a63125699fd None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:27.528060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174f64-8668-42b5-82f9-5a63125699fd None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:27.528530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174f64-8668-42b5-82f9-5a63125699fd None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:27.530515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 72/146] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:24:27.537491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33cbe0-ef33-46ce-be7d-10ba0030ed27 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:27.538418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb295d9e-15b7-466a-a6c5-164e316d70ba None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:27.538943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb295d9e-15b7-466a-a6c5-164e316d70ba None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:27.539415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb295d9e-15b7-466a-a6c5-164e316d70ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:27.557504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-fb295d9e-15b7-466a-a6c5-164e316d70ba None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:27.559038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-fb295d9e-15b7-466a-a6c5-164e316d70ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:27.580904 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de2367-8bc2-452d-963c-998c7f751055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:27.581946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de2367-8bc2-452d-963c-998c7f751055 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:27.582068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de2367-8bc2-452d-963c-998c7f751055 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:27.582301 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de2367-8bc2-452d-963c-998c7f751055 None admin] PATH_INFO: `/v3/users/69fe978b74134375b981ad69574fe05b` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:27.583554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de2367-8bc2-452d-963c-998c7f751055 None admin] RBAC: Authorizing `identity:get_user(user_id=69fe978b74134375b981ad69574fe05b)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:27.585065 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de2367-8bc2-452d-963c-998c7f751055 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:27.586560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 75/147] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:27 2022] GET /identity/v3/users/69fe978b74134375b981ad69574fe05b => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:27.592053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de2367-8bc2-452d-963c-998c7f751055 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:27.631977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 73/148] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:27.676608 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb295d9e-15b7-466a-a6c5-164e316d70ba None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:27.777675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de2367-8bc2-452d-963c-998c7f751055 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:27.841157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb295d9e-15b7-466a-a6c5-164e316d70ba None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:27.875257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8509f-7f6d-47d8-ac4e-0b39804cd44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:27.876158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8509f-7f6d-47d8-ac4e-0b39804cd44c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:27.876475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8509f-7f6d-47d8-ac4e-0b39804cd44c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:27.876692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8509f-7f6d-47d8-ac4e-0b39804cd44c None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:27.883732 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8509f-7f6d-47d8-ac4e-0b39804cd44c None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:27.885216 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8509f-7f6d-47d8-ac4e-0b39804cd44c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:27.887255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 76/149] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:27 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:27.888715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc4eea-744c-4c9a-bc58-215cccef51da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:27.889752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc4eea-744c-4c9a-bc58-215cccef51da None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:27.890245 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc4eea-744c-4c9a-bc58-215cccef51da None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:27.890709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc4eea-744c-4c9a-bc58-215cccef51da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:27.893433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8509f-7f6d-47d8-ac4e-0b39804cd44c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:27.905261 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc4eea-744c-4c9a-bc58-215cccef51da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:27.917250 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-6fbc4eea-744c-4c9a-bc58-215cccef51da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:24:27.918727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 74/150] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:24:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:24:27.924743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc4eea-744c-4c9a-bc58-215cccef51da None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:28.049502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8509f-7f6d-47d8-ac4e-0b39804cd44c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:28.058245 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc4eea-744c-4c9a-bc58-215cccef51da None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:28.110928 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d4ad0-2d3c-4218-8dce-c5b1007cf3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:28.112470 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d4ad0-2d3c-4218-8dce-c5b1007cf3bd None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:28.113018 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d4ad0-2d3c-4218-8dce-c5b1007cf3bd None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:28.113434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d4ad0-2d3c-4218-8dce-c5b1007cf3bd None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/users/69fe978b74134375b981ad69574fe05b/roles/1b0597a6df10450bb5b56ed2c8b6261d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:28.115727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d4ad0-2d3c-4218-8dce-c5b1007cf3bd None admin] RBAC: Authorizing `identity:create_grant(project_id=c72151b764de430b89f44fcf9d7e9dbb, user_id=69fe978b74134375b981ad69574fe05b, role_id=1b0597a6df10450bb5b56ed2c8b6261d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:28.117441 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4cc8c-221a-49fa-bfd3-8fdf0daa5bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:28.117706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d4ad0-2d3c-4218-8dce-c5b1007cf3bd None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:28.118333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4cc8c-221a-49fa-bfd3-8fdf0daa5bc0 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:28.118717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4cc8c-221a-49fa-bfd3-8fdf0daa5bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:28.119118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4cc8c-221a-49fa-bfd3-8fdf0daa5bc0 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:28.119977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4cc8c-221a-49fa-bfd3-8fdf0daa5bc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:28.120387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4cc8c-221a-49fa-bfd3-8fdf0daa5bc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:28.122118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4cc8c-221a-49fa-bfd3-8fdf0daa5bc0 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:28.138678 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 75/151] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:28.139084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 77/152] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:24:27 2022] PUT /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/users/69fe978b74134375b981ad69574fe05b/roles/1b0597a6df10450bb5b56ed2c8b6261d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:24:28.144665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4cc8c-221a-49fa-bfd3-8fdf0daa5bc0 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:28.262161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4cc8c-221a-49fa-bfd3-8fdf0daa5bc0 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:28.306527 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00417d9-615f-4523-b6a9-37d2cb343f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:28.307354 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00417d9-615f-4523-b6a9-37d2cb343f64 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:28.307639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00417d9-615f-4523-b6a9-37d2cb343f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:28.307921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00417d9-615f-4523-b6a9-37d2cb343f64 None admin] PATH_INFO: `/v3/users/870ce38416184f81819ea6b48f497b2a` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:28.309295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00417d9-615f-4523-b6a9-37d2cb343f64 None admin] RBAC: Authorizing `identity:get_user(user_id=870ce38416184f81819ea6b48f497b2a)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:28.310862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00417d9-615f-4523-b6a9-37d2cb343f64 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:28.312630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 76/153] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:28 2022] GET /identity/v3/users/870ce38416184f81819ea6b48f497b2a => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:28.318280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d4ad0-2d3c-4218-8dce-c5b1007cf3bd None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:28.439942 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d4ad0-2d3c-4218-8dce-c5b1007cf3bd None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:28.475922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610485c-49bf-47ac-8c77-11015ff6c4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:28.476959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610485c-49bf-47ac-8c77-11015ff6c4c2 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:28.477440 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610485c-49bf-47ac-8c77-11015ff6c4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:28.477908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610485c-49bf-47ac-8c77-11015ff6c4c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:28.549739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610485c-49bf-47ac-8c77-11015ff6c4c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:28.551578 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610485c-49bf-47ac-8c77-11015ff6c4c2 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:28.565173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef071-69a5-43ff-8a00-f2c536fc5b82 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:28.565444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef071-69a5-43ff-8a00-f2c536fc5b82 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:28.565662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef071-69a5-43ff-8a00-f2c536fc5b82 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:28.567545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 77/154] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:28.576186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32af59-43e7-4caa-84e8-14e5ded38e5c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:28.576467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32af59-43e7-4caa-84e8-14e5ded38e5c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:28.576743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32af59-43e7-4caa-84e8-14e5ded38e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:28.608001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-1f32af59-43e7-4caa-84e8-14e5ded38e5c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:28.609290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-1f32af59-43e7-4caa-84e8-14e5ded38e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:28.653283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 78/155] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:28.659423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610485c-49bf-47ac-8c77-11015ff6c4c2 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:28.745270 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 78/156] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:28.783006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32af59-43e7-4caa-84e8-14e5ded38e5c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:28.786551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610485c-49bf-47ac-8c77-11015ff6c4c2 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:28.829467 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32ad87-4fad-4750-8cbc-952add8c2acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:28.830763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32ad87-4fad-4750-8cbc-952add8c2acf None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:28.831304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32ad87-4fad-4750-8cbc-952add8c2acf None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:28.831769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32ad87-4fad-4750-8cbc-952add8c2acf None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:28.833189 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32ad87-4fad-4750-8cbc-952add8c2acf None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:28.834832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32ad87-4fad-4750-8cbc-952add8c2acf None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:28.836752 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 79/157] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:28 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:28.842351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32ad87-4fad-4750-8cbc-952add8c2acf None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:28.975127 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32ad87-4fad-4750-8cbc-952add8c2acf None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:28.997732 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32af59-43e7-4caa-84e8-14e5ded38e5c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:29.025052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634c75f-17ee-4306-87d1-ce81bf5b66d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:29.026082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634c75f-17ee-4306-87d1-ce81bf5b66d8 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.026563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634c75f-17ee-4306-87d1-ce81bf5b66d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.027052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634c75f-17ee-4306-87d1-ce81bf5b66d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.028088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634c75f-17ee-4306-87d1-ce81bf5b66d8 None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb, user.id=870ce38416184f81819ea6b48f497b2a) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:29.028589 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634c75f-17ee-4306-87d1-ce81bf5b66d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:29.030234 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634c75f-17ee-4306-87d1-ce81bf5b66d8 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:29.036893 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 80/158] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:28 2022] GET /identity/v3/role_assignments?user.id=870ce38416184f81819ea6b48f497b2a&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:29.054794 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049bbdf-9414-45e0-a7c4-cbb53a74da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:29.055963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049bbdf-9414-45e0-a7c4-cbb53a74da91 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.056457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049bbdf-9414-45e0-a7c4-cbb53a74da91 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.056929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049bbdf-9414-45e0-a7c4-cbb53a74da91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.073345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049bbdf-9414-45e0-a7c4-cbb53a74da91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:29.089520 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-5049bbdf-9414-45e0-a7c4-cbb53a74da91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:24:29.095308 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 79/159] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:24:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:24:29.101220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634c75f-17ee-4306-87d1-ce81bf5b66d8 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:29.212238 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634c75f-17ee-4306-87d1-ce81bf5b66d8 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:29.248467 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025ff73-95e2-4222-aeaf-65db8e0ed03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:29.249546 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ff73-95e2-4222-aeaf-65db8e0ed03f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.250038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ff73-95e2-4222-aeaf-65db8e0ed03f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.250521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ff73-95e2-4222-aeaf-65db8e0ed03f None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.251481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025ff73-95e2-4222-aeaf-65db8e0ed03f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:29.252096 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025ff73-95e2-4222-aeaf-65db8e0ed03f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:29.253654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025ff73-95e2-4222-aeaf-65db8e0ed03f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:29.262957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 81/160] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:24:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:29.268494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049bbdf-9414-45e0-a7c4-cbb53a74da91 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:29.379734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386d24-5dea-422d-9d67-49268ac6a874 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.380384 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386d24-5dea-422d-9d67-49268ac6a874 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.380851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386d24-5dea-422d-9d67-49268ac6a874 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.382832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 82/161] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:24:29.388903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79970774-ad6d-4ab4-8548-f5d7ed80d6ff None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.389522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79970774-ad6d-4ab4-8548-f5d7ed80d6ff None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.389989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79970774-ad6d-4ab4-8548-f5d7ed80d6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.403159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049bbdf-9414-45e0-a7c4-cbb53a74da91 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:29.421812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-79970774-ad6d-4ab4-8548-f5d7ed80d6ff None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:29.423508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-79970774-ad6d-4ab4-8548-f5d7ed80d6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:29.463997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f52cb5-6d04-4eeb-b6ee-0f9afd6115d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:29.464881 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f52cb5-6d04-4eeb-b6ee-0f9afd6115d8 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.465156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f52cb5-6d04-4eeb-b6ee-0f9afd6115d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.465425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f52cb5-6d04-4eeb-b6ee-0f9afd6115d8 None admin] PATH_INFO: `/v3/users/48947de8105644d9bd2143a64e99e110` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.467276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f52cb5-6d04-4eeb-b6ee-0f9afd6115d8 None admin] RBAC: Authorizing `identity:get_user(user_id=48947de8105644d9bd2143a64e99e110)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:29.468742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f52cb5-6d04-4eeb-b6ee-0f9afd6115d8 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:29.470372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 80/162] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:29 2022] GET /identity/v3/users/48947de8105644d9bd2143a64e99e110 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:29.472129 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c858d-c1ce-493c-848f-9e0f957ea02c None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.472410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c858d-c1ce-493c-848f-9e0f957ea02c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.472774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c858d-c1ce-493c-848f-9e0f957ea02c None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.474301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 81/163] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:29.483900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c858d-c1ce-493c-848f-9e0f957ea02c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:29.497864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 83/164] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:29.499534 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6a728-24ab-4f46-9a08-1c6215f78829 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.500038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6a728-24ab-4f46-9a08-1c6215f78829 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.500549 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6a728-24ab-4f46-9a08-1c6215f78829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.517890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-8ab6a728-24ab-4f46-9a08-1c6215f78829 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:29.519413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8ab6a728-24ab-4f46-9a08-1c6215f78829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:29.586649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 84/165] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:29.587907 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6a728-24ab-4f46-9a08-1c6215f78829 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:29.692592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6a728-24ab-4f46-9a08-1c6215f78829 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:29.716548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c858d-c1ce-493c-848f-9e0f957ea02c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:29.729163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eae622-b872-458f-9a1b-069706412a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:29.730264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eae622-b872-458f-9a1b-069706412a8f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.730812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eae622-b872-458f-9a1b-069706412a8f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.731297 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eae622-b872-458f-9a1b-069706412a8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.741910 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eae622-b872-458f-9a1b-069706412a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:29.749113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-72eae622-b872-458f-9a1b-069706412a8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:29.750584 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 85/166] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:29.751607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eae622-b872-458f-9a1b-069706412a8f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:29.797003 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bba88-aeb3-4b03-aa61-e202a47acea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:29.797671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bba88-aeb3-4b03-aa61-e202a47acea4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.798152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bba88-aeb3-4b03-aa61-e202a47acea4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.798255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bba88-aeb3-4b03-aa61-e202a47acea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.886990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bba88-aeb3-4b03-aa61-e202a47acea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:29.888474 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bba88-aeb3-4b03-aa61-e202a47acea4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:29.938554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eae622-b872-458f-9a1b-069706412a8f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:30.019489 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 82/167] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:30.021090 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bba88-aeb3-4b03-aa61-e202a47acea4 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:30.044223 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6d4cc-a136-47e2-b2dc-2a6379592bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:30.045062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d4cc-a136-47e2-b2dc-2a6379592bd8 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:30.045358 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d4cc-a136-47e2-b2dc-2a6379592bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:30.045591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d4cc-a136-47e2-b2dc-2a6379592bd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:30.071617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6d4cc-a136-47e2-b2dc-2a6379592bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:30.090130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-95f6d4cc-a136-47e2-b2dc-2a6379592bd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:30.090130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 86/168] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:30.090130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6d4cc-a136-47e2-b2dc-2a6379592bd8 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:30.191351 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bba88-aeb3-4b03-aa61-e202a47acea4 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:30.207426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6d4cc-a136-47e2-b2dc-2a6379592bd8 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:30.243858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6606b7-4772-4c82-b732-3aff02094ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:30.245075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6606b7-4772-4c82-b732-3aff02094ef9 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:30.245550 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6606b7-4772-4c82-b732-3aff02094ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:30.246017 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6606b7-4772-4c82-b732-3aff02094ef9 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:30.247512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6606b7-4772-4c82-b732-3aff02094ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:30.249602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6606b7-4772-4c82-b732-3aff02094ef9 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:30.252494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 87/169] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:30 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:30.253587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6606b7-4772-4c82-b732-3aff02094ef9 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:30.291778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b87f8-3bc3-4db8-a13d-bd62269b198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:30.292386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b87f8-3bc3-4db8-a13d-bd62269b198f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:30.292663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b87f8-3bc3-4db8-a13d-bd62269b198f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:30.292932 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b87f8-3bc3-4db8-a13d-bd62269b198f None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:30.293700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b87f8-3bc3-4db8-a13d-bd62269b198f None admin] RBAC: Adding query filter params (name=member) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:30.294004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b87f8-3bc3-4db8-a13d-bd62269b198f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:30.295479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b87f8-3bc3-4db8-a13d-bd62269b198f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:30.316946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 83/170] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:30.317898 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b87f8-3bc3-4db8-a13d-bd62269b198f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:30.365941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6606b7-4772-4c82-b732-3aff02094ef9 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:30.400174 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257f0a2-a793-44f3-9097-61b9c4d3d9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:30.401202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f0a2-a793-44f3-9097-61b9c4d3d9c4 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:30.401678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f0a2-a793-44f3-9097-61b9c4d3d9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:30.402142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f0a2-a793-44f3-9097-61b9c4d3d9c4 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:30.403105 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257f0a2-a793-44f3-9097-61b9c4d3d9c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:30.403605 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257f0a2-a793-44f3-9097-61b9c4d3d9c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:30.405173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257f0a2-a793-44f3-9097-61b9c4d3d9c4 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:30.414497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 88/171] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:30.415685 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257f0a2-a793-44f3-9097-61b9c4d3d9c4 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:30.465661 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b87f8-3bc3-4db8-a13d-bd62269b198f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:30.514263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6e464-ef96-4c8e-bdde-1dc2e805e004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:30.514942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6e464-ef96-4c8e-bdde-1dc2e805e004 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:30.515225 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6e464-ef96-4c8e-bdde-1dc2e805e004 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:30.515497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6e464-ef96-4c8e-bdde-1dc2e805e004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:30.516327 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6e464-ef96-4c8e-bdde-1dc2e805e004 None admin] RBAC: Adding query filter params (role.id=79396755fc0842a882775515d6feab13, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb, user.id=48947de8105644d9bd2143a64e99e110) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:30.516637 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6e464-ef96-4c8e-bdde-1dc2e805e004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:30.516935 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257f0a2-a793-44f3-9097-61b9c4d3d9c4 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:30.518602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6e464-ef96-4c8e-bdde-1dc2e805e004 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:30.526477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 84/172] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:30 2022] GET /identity/v3/role_assignments?user.id=48947de8105644d9bd2143a64e99e110&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=79396755fc0842a882775515d6feab13 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:30.531455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6e464-ef96-4c8e-bdde-1dc2e805e004 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:30.554744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dc0b5-7f58-4fb2-86f6-fd2e25c9f21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:30.555994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dc0b5-7f58-4fb2-86f6-fd2e25c9f21f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:30.556470 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dc0b5-7f58-4fb2-86f6-fd2e25c9f21f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:30.556935 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dc0b5-7f58-4fb2-86f6-fd2e25c9f21f None admin] PATH_INFO: `/v3/users/48947de8105644d9bd2143a64e99e110` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:30.558443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758dc0b5-7f58-4fb2-86f6-fd2e25c9f21f None admin] RBAC: Authorizing `identity:get_user(user_id=48947de8105644d9bd2143a64e99e110)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:30.560234 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758dc0b5-7f58-4fb2-86f6-fd2e25c9f21f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:30.562553 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 89/173] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:30 2022] GET /identity/v3/users/48947de8105644d9bd2143a64e99e110 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:30.568441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dc0b5-7f58-4fb2-86f6-fd2e25c9f21f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:30.700055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dc0b5-7f58-4fb2-86f6-fd2e25c9f21f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:30.749010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce210c15-7906-4198-aca4-75301e708a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:30.750104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210c15-7906-4198-aca4-75301e708a41 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:30.750581 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210c15-7906-4198-aca4-75301e708a41 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:30.751092 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210c15-7906-4198-aca4-75301e708a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:30.829372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce210c15-7906-4198-aca4-75301e708a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:30.831408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce210c15-7906-4198-aca4-75301e708a41 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:30.836884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6e464-ef96-4c8e-bdde-1dc2e805e004 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:30.924206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842d605-eab4-4c77-87f3-ac726f81964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:30.925091 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842d605-eab4-4c77-87f3-ac726f81964e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:30.925365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842d605-eab4-4c77-87f3-ac726f81964e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:30.925831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842d605-eab4-4c77-87f3-ac726f81964e None admin] PATH_INFO: `/v3/users/48947de8105644d9bd2143a64e99e110` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:30.926850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842d605-eab4-4c77-87f3-ac726f81964e None admin] RBAC: Authorizing `identity:get_user(user_id=48947de8105644d9bd2143a64e99e110)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:30.928342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842d605-eab4-4c77-87f3-ac726f81964e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:30.931270 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 85/174] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:30 2022] GET /identity/v3/users/48947de8105644d9bd2143a64e99e110 => generated 275 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:30.932529 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5fcd5-681f-4612-adcd-4e5fbae8b6a4 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:30.932809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5fcd5-681f-4612-adcd-4e5fbae8b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:30.933082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5fcd5-681f-4612-adcd-4e5fbae8b6a4 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:30.934856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 86/175] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:30.939823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5fcd5-681f-4612-adcd-4e5fbae8b6a4 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:30.943417 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 90/176] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:24:30.944936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711a53-80d2-415f-85e7-826d3d17dc0f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:30.945445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711a53-80d2-415f-85e7-826d3d17dc0f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:30.945927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711a53-80d2-415f-85e7-826d3d17dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:30.963398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-af711a53-80d2-415f-85e7-826d3d17dc0f None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:30.964900 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-af711a53-80d2-415f-85e7-826d3d17dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:31.050037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 91/177] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:31.051698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af711a53-80d2-415f-85e7-826d3d17dc0f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:31.119565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5fcd5-681f-4612-adcd-4e5fbae8b6a4 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:31.160588 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af711a53-80d2-415f-85e7-826d3d17dc0f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:31.164837 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f435f3-d8f3-4d89-8eb1-2b2d729f6c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:31.165499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f435f3-d8f3-4d89-8eb1-2b2d729f6c68 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.165776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f435f3-d8f3-4d89-8eb1-2b2d729f6c68 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.166043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f435f3-d8f3-4d89-8eb1-2b2d729f6c68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.196750 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8a2f6-0ee7-4fe7-82b1-fd01cd69a4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:31.197931 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a2f6-0ee7-4fe7-82b1-fd01cd69a4ab None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.198430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a2f6-0ee7-4fe7-82b1-fd01cd69a4ab None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.198949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a2f6-0ee7-4fe7-82b1-fd01cd69a4ab None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.200352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8a2f6-0ee7-4fe7-82b1-fd01cd69a4ab None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:31.202050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8a2f6-0ee7-4fe7-82b1-fd01cd69a4ab None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:31.204084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 92/178] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:31 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:31.205651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8a2f6-0ee7-4fe7-82b1-fd01cd69a4ab None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:31.262586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f435f3-d8f3-4d89-8eb1-2b2d729f6c68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:31.264190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f435f3-d8f3-4d89-8eb1-2b2d729f6c68 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:31.310091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8a2f6-0ee7-4fe7-82b1-fd01cd69a4ab None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:31.344564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15a1d7-00bf-44a9-8acd-45efd65a0aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:31.345841 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15a1d7-00bf-44a9-8acd-45efd65a0aab None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.346348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15a1d7-00bf-44a9-8acd-45efd65a0aab None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.346832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15a1d7-00bf-44a9-8acd-45efd65a0aab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.357299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15a1d7-00bf-44a9-8acd-45efd65a0aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:31.365034 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-bb15a1d7-00bf-44a9-8acd-45efd65a0aab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:24:31.366469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 93/179] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:31.367510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15a1d7-00bf-44a9-8acd-45efd65a0aab None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:31.408644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 87/180] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:31.413859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f435f3-d8f3-4d89-8eb1-2b2d729f6c68 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:31.468803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15a1d7-00bf-44a9-8acd-45efd65a0aab None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:31.502002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d082f-c66b-43aa-b745-42424fcc3e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:31.503020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d082f-c66b-43aa-b745-42424fcc3e36 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.503496 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d082f-c66b-43aa-b745-42424fcc3e36 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.503961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d082f-c66b-43aa-b745-42424fcc3e36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.504971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d082f-c66b-43aa-b745-42424fcc3e36 None admin] RBAC: Adding query filter params (role.id=f8641f824b324fa2956c5fc5b764f8ae, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb, user.id=48947de8105644d9bd2143a64e99e110) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:31.505494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d082f-c66b-43aa-b745-42424fcc3e36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:31.507152 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d082f-c66b-43aa-b745-42424fcc3e36 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:31.511466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f435f3-d8f3-4d89-8eb1-2b2d729f6c68 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:31.513697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 94/181] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:31 2022] GET /identity/v3/role_assignments?user.id=48947de8105644d9bd2143a64e99e110&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:31.514679 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d082f-c66b-43aa-b745-42424fcc3e36 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:31.547407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44e52e-2384-449d-a921-4d585fcec2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:31.548128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44e52e-2384-449d-a921-4d585fcec2d3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.548427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44e52e-2384-449d-a921-4d585fcec2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.549301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44e52e-2384-449d-a921-4d585fcec2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.549998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44e52e-2384-449d-a921-4d585fcec2d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:31.550299 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44e52e-2384-449d-a921-4d585fcec2d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:31.551738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44e52e-2384-449d-a921-4d585fcec2d3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:31.561390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 88/182] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:31.562823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af2f1-7d90-4d23-affa-3053cd91a05f None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.563130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af2f1-7d90-4d23-affa-3053cd91a05f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.563398 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af2f1-7d90-4d23-affa-3053cd91a05f None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.565376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 89/183] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:31.566271 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40af2f1-7d90-4d23-affa-3053cd91a05f None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:31.658314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d082f-c66b-43aa-b745-42424fcc3e36 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:31.676725 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40af2f1-7d90-4d23-affa-3053cd91a05f None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:31.710471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a034a81-782d-45a6-9231-2ca4bb5ae962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:31.711800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a034a81-782d-45a6-9231-2ca4bb5ae962 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.712338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a034a81-782d-45a6-9231-2ca4bb5ae962 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.712710 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a034a81-782d-45a6-9231-2ca4bb5ae962 None admin] PATH_INFO: `/v3/projects/d0f534ff485043a9befb2523d64f8ad5` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.713986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a034a81-782d-45a6-9231-2ca4bb5ae962 None admin] RBAC: Authorizing `identity:get_project(project_id=d0f534ff485043a9befb2523d64f8ad5)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:31.716058 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a034a81-782d-45a6-9231-2ca4bb5ae962 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:31.716871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcda3c-f596-4403-9bc9-b7801ea16211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:31.717823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 95/184] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:31 2022] GET /identity/v3/projects/d0f534ff485043a9befb2523d64f8ad5 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:31.718537 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcda3c-f596-4403-9bc9-b7801ea16211 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.719129 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcda3c-f596-4403-9bc9-b7801ea16211 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.719602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcda3c-f596-4403-9bc9-b7801ea16211 None admin] PATH_INFO: `/v3/users/a80a7680c0534b3481d2b562acdc1bfe` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.724255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93853c6-523a-4242-b316-03cc2bd9bc79 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.724554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93853c6-523a-4242-b316-03cc2bd9bc79 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.724830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93853c6-523a-4242-b316-03cc2bd9bc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.735634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcda3c-f596-4403-9bc9-b7801ea16211 None admin] RBAC: Authorizing `identity:get_user(user_id=a80a7680c0534b3481d2b562acdc1bfe)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:31.737153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcda3c-f596-4403-9bc9-b7801ea16211 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:31.743071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 90/185] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:31 2022] GET /identity/v3/users/a80a7680c0534b3481d2b562acdc1bfe => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:31.744786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de2fe-ae6c-41ea-b8cb-af4fb2d46830 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.745066 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de2fe-ae6c-41ea-b8cb-af4fb2d46830 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.745336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de2fe-ae6c-41ea-b8cb-af4fb2d46830 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.745943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f93853c6-523a-4242-b316-03cc2bd9bc79 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:31.747180 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f93853c6-523a-4242-b316-03cc2bd9bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:31.747343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 91/186] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:31.748025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102de2fe-ae6c-41ea-b8cb-af4fb2d46830 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:31.836435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 96/187] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:31.837126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93853c6-523a-4242-b316-03cc2bd9bc79 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:31.864707 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102de2fe-ae6c-41ea-b8cb-af4fb2d46830 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:31.898486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d950b-46d9-45c4-8908-700a7e2694b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:31.899165 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d950b-46d9-45c4-8908-700a7e2694b2 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.899439 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d950b-46d9-45c4-8908-700a7e2694b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.899709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d950b-46d9-45c4-8908-700a7e2694b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.900591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d950b-46d9-45c4-8908-700a7e2694b2 None admin] RBAC: Adding query filter params (role.id=f8641f824b324fa2956c5fc5b764f8ae, scope.project.id=d0f534ff485043a9befb2523d64f8ad5, user.id=48947de8105644d9bd2143a64e99e110) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:31.900901 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d950b-46d9-45c4-8908-700a7e2694b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:31.902336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d950b-46d9-45c4-8908-700a7e2694b2 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:31.915195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 92/188] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:31 2022] GET /identity/v3/role_assignments?user.id=48947de8105644d9bd2143a64e99e110&scope.project.id=d0f534ff485043a9befb2523d64f8ad5&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:31.915195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a229bcc-9d81-43ef-bb46-3e6a508f8687 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:31.915195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a229bcc-9d81-43ef-bb46-3e6a508f8687 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:31.915195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a229bcc-9d81-43ef-bb46-3e6a508f8687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:31.928710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-6a229bcc-9d81-43ef-bb46-3e6a508f8687 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:31.929955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6a229bcc-9d81-43ef-bb46-3e6a508f8687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:31.966800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93853c6-523a-4242-b316-03cc2bd9bc79 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:32.003692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6186df3-37ee-44da-b6dc-606f720298a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:32.004344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6186df3-37ee-44da-b6dc-606f720298a2 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.004536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 93/189] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:32.005397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a229bcc-9d81-43ef-bb46-3e6a508f8687 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:32.011472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6186df3-37ee-44da-b6dc-606f720298a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.011818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6186df3-37ee-44da-b6dc-606f720298a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.131511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a229bcc-9d81-43ef-bb46-3e6a508f8687 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:32.140436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6186df3-37ee-44da-b6dc-606f720298a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:32.143636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6186df3-37ee-44da-b6dc-606f720298a2 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:32.180716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed801b-0b66-4a0c-8079-07bf75fc7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:32.182010 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed801b-0b66-4a0c-8079-07bf75fc7b73 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.182709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed801b-0b66-4a0c-8079-07bf75fc7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.182709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed801b-0b66-4a0c-8079-07bf75fc7b73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.207556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed801b-0b66-4a0c-8079-07bf75fc7b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:32.215374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-c6ed801b-0b66-4a0c-8079-07bf75fc7b73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:24:32.216687 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 94/190] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:24:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:32.217569 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed801b-0b66-4a0c-8079-07bf75fc7b73 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:32.290611 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 97/191] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:32.292119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6186df3-37ee-44da-b6dc-606f720298a2 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:32.350229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed801b-0b66-4a0c-8079-07bf75fc7b73 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:32.387457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d772c8-12fa-490e-8a10-a1c3917256d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:32.388397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d772c8-12fa-490e-8a10-a1c3917256d0 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.388787 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d772c8-12fa-490e-8a10-a1c3917256d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.389063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d772c8-12fa-490e-8a10-a1c3917256d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.390291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d772c8-12fa-490e-8a10-a1c3917256d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:32.391829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d772c8-12fa-490e-8a10-a1c3917256d0 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:32.398565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 95/192] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:32.398565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d772c8-12fa-490e-8a10-a1c3917256d0 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:32.412446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6186df3-37ee-44da-b6dc-606f720298a2 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:32.446432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992156f7-7d13-4d6b-998e-29faf95de77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:32.447054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992156f7-7d13-4d6b-998e-29faf95de77c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.447339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992156f7-7d13-4d6b-998e-29faf95de77c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.447610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992156f7-7d13-4d6b-998e-29faf95de77c None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.448388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992156f7-7d13-4d6b-998e-29faf95de77c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:32.448705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992156f7-7d13-4d6b-998e-29faf95de77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:32.450058 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992156f7-7d13-4d6b-998e-29faf95de77c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:32.458952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 98/193] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:24:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:32.459326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992156f7-7d13-4d6b-998e-29faf95de77c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:32.498072 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d772c8-12fa-490e-8a10-a1c3917256d0 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:32.532388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667dca6-cd63-49a3-9259-b3272ddf5e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:32.533691 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667dca6-cd63-49a3-9259-b3272ddf5e30 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.533975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667dca6-cd63-49a3-9259-b3272ddf5e30 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.534251 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667dca6-cd63-49a3-9259-b3272ddf5e30 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.535844 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667dca6-cd63-49a3-9259-b3272ddf5e30 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:32.537932 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667dca6-cd63-49a3-9259-b3272ddf5e30 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:32.540395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 96/194] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:32 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:32.540956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667dca6-cd63-49a3-9259-b3272ddf5e30 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:32.561023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992156f7-7d13-4d6b-998e-29faf95de77c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:32.596253 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488b796-663d-4883-8b75-074a1492b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:32.596915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488b796-663d-4883-8b75-074a1492b884 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.597194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488b796-663d-4883-8b75-074a1492b884 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.597466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488b796-663d-4883-8b75-074a1492b884 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.598169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488b796-663d-4883-8b75-074a1492b884 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:32.599628 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488b796-663d-4883-8b75-074a1492b884 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:32.624953 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 99/195] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:24:32 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:24:32.625820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488b796-663d-4883-8b75-074a1492b884 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:32.643482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667dca6-cd63-49a3-9259-b3272ddf5e30 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:32.683365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dbe20-ed1e-4728-9a07-1d613d5bd0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:32.684264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dbe20-ed1e-4728-9a07-1d613d5bd0f7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.684537 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dbe20-ed1e-4728-9a07-1d613d5bd0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.684808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dbe20-ed1e-4728-9a07-1d613d5bd0f7 None admin] PATH_INFO: `/v3/users/a80a7680c0534b3481d2b562acdc1bfe` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.686100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dbe20-ed1e-4728-9a07-1d613d5bd0f7 None admin] RBAC: Authorizing `identity:get_user(user_id=a80a7680c0534b3481d2b562acdc1bfe)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:32.687633 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dbe20-ed1e-4728-9a07-1d613d5bd0f7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:32.694926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 97/196] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:32 2022] GET /identity/v3/users/a80a7680c0534b3481d2b562acdc1bfe => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:32.694926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270ab8-cad0-4adf-b909-e8c1f704efd1 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.694926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270ab8-cad0-4adf-b909-e8c1f704efd1 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.694926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270ab8-cad0-4adf-b909-e8c1f704efd1 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.694926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 98/197] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:32.695767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b270ab8-cad0-4adf-b909-e8c1f704efd1 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:32.742675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488b796-663d-4883-8b75-074a1492b884 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:32.778480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505aafa8-ea61-40da-96be-c84414ee237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:32.779195 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aafa8-ea61-40da-96be-c84414ee237e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.779483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aafa8-ea61-40da-96be-c84414ee237e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.779755 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aafa8-ea61-40da-96be-c84414ee237e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.780620 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505aafa8-ea61-40da-96be-c84414ee237e None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=c02cb7cef6b84d34815a0826d3396e94, user.id=a80a7680c0534b3481d2b562acdc1bfe) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:32.780940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505aafa8-ea61-40da-96be-c84414ee237e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:32.782461 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505aafa8-ea61-40da-96be-c84414ee237e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:32.798958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 100/198] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:32 2022] GET /identity/v3/role_assignments?user.id=a80a7680c0534b3481d2b562acdc1bfe&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:32.798958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8802c-6454-42de-9ef3-7a4b03af693a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.798958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8802c-6454-42de-9ef3-7a4b03af693a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.798958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8802c-6454-42de-9ef3-7a4b03af693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.817277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b270ab8-cad0-4adf-b909-e8c1f704efd1 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:32.819907 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-71a8802c-6454-42de-9ef3-7a4b03af693a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:32.821147 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-71a8802c-6454-42de-9ef3-7a4b03af693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:32.866395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0edb3-5fbe-467b-b267-3559a7a79329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:32.866618 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0edb3-5fbe-467b-b267-3559a7a79329 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.866846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0edb3-5fbe-467b-b267-3559a7a79329 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.867025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0edb3-5fbe-467b-b267-3559a7a79329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.909203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 101/199] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:32.932623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8802c-6454-42de-9ef3-7a4b03af693a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:32.953886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0edb3-5fbe-467b-b267-3559a7a79329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:32.956369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0edb3-5fbe-467b-b267-3559a7a79329 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:33.059647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 99/200] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:33.066304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8802c-6454-42de-9ef3-7a4b03af693a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:33.067846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0edb3-5fbe-467b-b267-3559a7a79329 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:33.115724 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305e212-63d3-4298-ad67-81893d5844bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:33.116517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e212-63d3-4298-ad67-81893d5844bb None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:33.116802 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e212-63d3-4298-ad67-81893d5844bb None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:33.117081 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e212-63d3-4298-ad67-81893d5844bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:33.127898 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305e212-63d3-4298-ad67-81893d5844bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:33.134842 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-9305e212-63d3-4298-ad67-81893d5844bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:24:33.136689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 102/201] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:33.141940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305e212-63d3-4298-ad67-81893d5844bb None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:33.197585 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0edb3-5fbe-467b-b267-3559a7a79329 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:33.254760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b831af6-a480-48e6-b128-5c323a07ae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:33.256042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831af6-a480-48e6-b128-5c323a07ae3b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:33.256538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831af6-a480-48e6-b128-5c323a07ae3b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:33.257009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831af6-a480-48e6-b128-5c323a07ae3b None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:33.259809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b831af6-a480-48e6-b128-5c323a07ae3b None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:33.261764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b831af6-a480-48e6-b128-5c323a07ae3b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:33.266280 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 100/202] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:33 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:33.273353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b831af6-a480-48e6-b128-5c323a07ae3b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:33.315024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305e212-63d3-4298-ad67-81893d5844bb None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:33.405520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765dbbb-377f-4e79-8c8e-1d1ed6416b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:33.406540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765dbbb-377f-4e79-8c8e-1d1ed6416b7e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:33.407054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765dbbb-377f-4e79-8c8e-1d1ed6416b7e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:33.407553 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765dbbb-377f-4e79-8c8e-1d1ed6416b7e None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:33.409215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765dbbb-377f-4e79-8c8e-1d1ed6416b7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:33.409715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765dbbb-377f-4e79-8c8e-1d1ed6416b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:33.411289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765dbbb-377f-4e79-8c8e-1d1ed6416b7e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:33.418920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b831af6-a480-48e6-b128-5c323a07ae3b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:33.430019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 103/203] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:33.435476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765dbbb-377f-4e79-8c8e-1d1ed6416b7e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:33.457172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f8c63-9387-461d-a695-611d7ecc59d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:33.458853 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f8c63-9387-461d-a695-611d7ecc59d2 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:33.460323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f8c63-9387-461d-a695-611d7ecc59d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:33.460949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f8c63-9387-461d-a695-611d7ecc59d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:33.463038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f8c63-9387-461d-a695-611d7ecc59d2 None admin] RBAC: Adding query filter params (role.id=79396755fc0842a882775515d6feab13, scope.project.id=c02cb7cef6b84d34815a0826d3396e94, user.id=a80a7680c0534b3481d2b562acdc1bfe) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:33.464090 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f8c63-9387-461d-a695-611d7ecc59d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:33.468075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f8c63-9387-461d-a695-611d7ecc59d2 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:33.479122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 101/204] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:33 2022] GET /identity/v3/role_assignments?user.id=a80a7680c0534b3481d2b562acdc1bfe&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=79396755fc0842a882775515d6feab13 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:33.568293 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765dbbb-377f-4e79-8c8e-1d1ed6416b7e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:33.606165 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ba997-9c04-4a12-826b-4ee64120fac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:33.607110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ba997-9c04-4a12-826b-4ee64120fac1 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:33.607393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ba997-9c04-4a12-826b-4ee64120fac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:33.607667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ba997-9c04-4a12-826b-4ee64120fac1 None admin] PATH_INFO: `/v3/users/69fe978b74134375b981ad69574fe05b` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:33.608961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ba997-9c04-4a12-826b-4ee64120fac1 None admin] RBAC: Authorizing `identity:get_user(user_id=69fe978b74134375b981ad69574fe05b)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:33.610469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ba997-9c04-4a12-826b-4ee64120fac1 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:33.612926 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 104/205] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:33 2022] GET /identity/v3/users/69fe978b74134375b981ad69574fe05b => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:33.618470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f8c63-9387-461d-a695-611d7ecc59d2 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:33.778481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f8c63-9387-461d-a695-611d7ecc59d2 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:33.834667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91754590-8051-4c08-bd85-e2c9b33b13c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:33.835423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91754590-8051-4c08-bd85-e2c9b33b13c0 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:33.835720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91754590-8051-4c08-bd85-e2c9b33b13c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:33.836009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91754590-8051-4c08-bd85-e2c9b33b13c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:33.930259 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91754590-8051-4c08-bd85-e2c9b33b13c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:33.931820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91754590-8051-4c08-bd85-e2c9b33b13c0 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:34.074525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 102/206] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:34.087350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ba997-9c04-4a12-826b-4ee64120fac1 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:34.257378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ba997-9c04-4a12-826b-4ee64120fac1 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:34.304943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7037b37-b4a3-489d-9853-5106f02cf594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:34.305792 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7037b37-b4a3-489d-9853-5106f02cf594 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:34.306070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7037b37-b4a3-489d-9853-5106f02cf594 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:34.306340 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7037b37-b4a3-489d-9853-5106f02cf594 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:34.307549 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7037b37-b4a3-489d-9853-5106f02cf594 None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:34.308998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7037b37-b4a3-489d-9853-5106f02cf594 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:34.310738 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 105/207] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:34 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:34.316661 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91754590-8051-4c08-bd85-e2c9b33b13c0 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:34.449548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91754590-8051-4c08-bd85-e2c9b33b13c0 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:34.483324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed807b-3e1f-4c61-965b-c4833a701fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:34.483969 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed807b-3e1f-4c61-965b-c4833a701fbd None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:34.484244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed807b-3e1f-4c61-965b-c4833a701fbd None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:34.484512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed807b-3e1f-4c61-965b-c4833a701fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:34.485320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed807b-3e1f-4c61-965b-c4833a701fbd None admin] RBAC: Adding query filter params (role.id=1b0597a6df10450bb5b56ed2c8b6261d, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb, user.id=69fe978b74134375b981ad69574fe05b) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:34.485624 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed807b-3e1f-4c61-965b-c4833a701fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:34.487120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed807b-3e1f-4c61-965b-c4833a701fbd None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:34.492718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 103/208] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:34 2022] GET /identity/v3/role_assignments?user.id=69fe978b74134375b981ad69574fe05b&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=1b0597a6df10450bb5b56ed2c8b6261d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:35.474680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf61a-c0fa-4510-ad0f-e59a937b29d0 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:35.475237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf61a-c0fa-4510-ad0f-e59a937b29d0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:35.475237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf61a-c0fa-4510-ad0f-e59a937b29d0 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:35.477006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 106/209] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:35.482312 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649fad8-a85d-41b3-8c9b-a9b8c3e8352a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:35.483136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649fad8-a85d-41b3-8c9b-a9b8c3e8352a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:35.483621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649fad8-a85d-41b3-8c9b-a9b8c3e8352a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:35.500726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-7649fad8-a85d-41b3-8c9b-a9b8c3e8352a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:35.502727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7649fad8-a85d-41b3-8c9b-a9b8c3e8352a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:35.541036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb64ac-d05f-4914-b026-72cfd8bbaef3 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:35.541365 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb64ac-d05f-4914-b026-72cfd8bbaef3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:35.541630 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb64ac-d05f-4914-b026-72cfd8bbaef3 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:35.543618 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 107/210] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:24:35.552502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943eada-bbfd-4bbf-811b-d0819fb255b8 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:35.553188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943eada-bbfd-4bbf-811b-d0819fb255b8 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:35.554021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943eada-bbfd-4bbf-811b-d0819fb255b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:35.572663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 104/211] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:35.574045 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f802d9f-7f38-4e51-a16c-343e5f3e49f9 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:35.574333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f802d9f-7f38-4e51-a16c-343e5f3e49f9 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:35.574608 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f802d9f-7f38-4e51-a16c-343e5f3e49f9 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:35.576591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 105/212] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:35.577664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-0943eada-bbfd-4bbf-811b-d0819fb255b8 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:35.579448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0943eada-bbfd-4bbf-811b-d0819fb255b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:35.581902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf99102-1614-46a9-a763-00818cbfaf14 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:35.582187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf99102-1614-46a9-a763-00818cbfaf14 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:35.582461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf99102-1614-46a9-a763-00818cbfaf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:35.601355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0bf99102-1614-46a9-a763-00818cbfaf14 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:35.602715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0bf99102-1614-46a9-a763-00818cbfaf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:35.653622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 108/213] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:35.660214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943eada-bbfd-4bbf-811b-d0819fb255b8 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:35.680458 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 106/214] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:35.681331 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf99102-1614-46a9-a763-00818cbfaf14 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:35.779008 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943eada-bbfd-4bbf-811b-d0819fb255b8 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:35.781252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf99102-1614-46a9-a763-00818cbfaf14 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:35.812634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5488d-f59c-4459-aff3-b4c15a35aa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:35.813424 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5488d-f59c-4459-aff3-b4c15a35aa9c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:35.813706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5488d-f59c-4459-aff3-b4c15a35aa9c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:35.814006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5488d-f59c-4459-aff3-b4c15a35aa9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:35.814999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85aea-e6cb-4558-b1e6-da9c080ff581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:35.815715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85aea-e6cb-4558-b1e6-da9c080ff581 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:35.815994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85aea-e6cb-4558-b1e6-da9c080ff581 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:35.816262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85aea-e6cb-4558-b1e6-da9c080ff581 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:35.824744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5488d-f59c-4459-aff3-b4c15a35aa9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:35.826170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d85aea-e6cb-4558-b1e6-da9c080ff581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:35.831565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-d5b5488d-f59c-4459-aff3-b4c15a35aa9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:24:35.832928 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 109/215] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:35.833536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5488d-f59c-4459-aff3-b4c15a35aa9c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:35.833767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-d6d85aea-e6cb-4558-b1e6-da9c080ff581 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:35.838946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 107/216] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:35.840324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85aea-e6cb-4558-b1e6-da9c080ff581 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:35.933102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5488d-f59c-4459-aff3-b4c15a35aa9c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:35.943863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85aea-e6cb-4558-b1e6-da9c080ff581 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:35.968067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75d45-b698-48fe-972e-7de92831bb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:35.968861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75d45-b698-48fe-972e-7de92831bb41 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:35.969140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75d45-b698-48fe-972e-7de92831bb41 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:35.969486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75d45-b698-48fe-972e-7de92831bb41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:35.970716 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75d45-b698-48fe-972e-7de92831bb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:35.972193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75d45-b698-48fe-972e-7de92831bb41 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:35.973794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 110/217] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:35.974653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75d45-b698-48fe-972e-7de92831bb41 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:35.982530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45269a7-486d-4390-aa57-9195d7712406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:35.983430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45269a7-486d-4390-aa57-9195d7712406 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:35.983848 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45269a7-486d-4390-aa57-9195d7712406 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:35.984259 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45269a7-486d-4390-aa57-9195d7712406 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:35.985137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45269a7-486d-4390-aa57-9195d7712406 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:35.985580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45269a7-486d-4390-aa57-9195d7712406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:35.987652 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45269a7-486d-4390-aa57-9195d7712406 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:35.996042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 108/218] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:35.996969 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45269a7-486d-4390-aa57-9195d7712406 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:36.091270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75d45-b698-48fe-972e-7de92831bb41 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:36.106969 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45269a7-486d-4390-aa57-9195d7712406 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:36.127596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eaf8c-37e9-4cc3-aa02-c51211a35cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:36.128704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eaf8c-37e9-4cc3-aa02-c51211a35cd6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:36.128986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eaf8c-37e9-4cc3-aa02-c51211a35cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:36.129541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eaf8c-37e9-4cc3-aa02-c51211a35cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:36.130293 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eaf8c-37e9-4cc3-aa02-c51211a35cd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:36.130765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eaf8c-37e9-4cc3-aa02-c51211a35cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:36.132787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eaf8c-37e9-4cc3-aa02-c51211a35cd6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:36.142394 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e300f-8986-4d75-8c2b-e86a51e4746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:36.147556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 111/219] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:36.147676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e300f-8986-4d75-8c2b-e86a51e4746b None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:36.147676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e300f-8986-4d75-8c2b-e86a51e4746b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:36.147832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eaf8c-37e9-4cc3-aa02-c51211a35cd6 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:36.147900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e300f-8986-4d75-8c2b-e86a51e4746b None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:36.147900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e300f-8986-4d75-8c2b-e86a51e4746b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:36.147900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e300f-8986-4d75-8c2b-e86a51e4746b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:36.170009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 109/220] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:24:35 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:24:36.171162 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e300f-8986-4d75-8c2b-e86a51e4746b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:36.287423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eaf8c-37e9-4cc3-aa02-c51211a35cd6 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:36.305273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e300f-8986-4d75-8c2b-e86a51e4746b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:36.324807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead42bf-bc14-4647-b857-f7d3248389f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:36.326072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead42bf-bc14-4647-b857-f7d3248389f7 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:36.326616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead42bf-bc14-4647-b857-f7d3248389f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:36.327117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead42bf-bc14-4647-b857-f7d3248389f7 None admin] PATH_INFO: `/v3/users/a80a7680c0534b3481d2b562acdc1bfe` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:36.328668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead42bf-bc14-4647-b857-f7d3248389f7 None admin] RBAC: Authorizing `identity:get_user(user_id=a80a7680c0534b3481d2b562acdc1bfe)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:36.330414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead42bf-bc14-4647-b857-f7d3248389f7 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:36.332476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 112/221] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:36 2022] GET /identity/v3/users/a80a7680c0534b3481d2b562acdc1bfe => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:36.338155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead42bf-bc14-4647-b857-f7d3248389f7 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:36.347825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70034cbe-a007-4043-ae13-f38fb2b9eb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:36.348969 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70034cbe-a007-4043-ae13-f38fb2b9eb7b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:36.349721 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70034cbe-a007-4043-ae13-f38fb2b9eb7b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:36.349721 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70034cbe-a007-4043-ae13-f38fb2b9eb7b None admin] PATH_INFO: `/v3/users/6cafd0f9f2f34178aa343385780d84ce` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:36.367682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70034cbe-a007-4043-ae13-f38fb2b9eb7b None admin] RBAC: Authorizing `identity:get_user(user_id=6cafd0f9f2f34178aa343385780d84ce)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:36.369181 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70034cbe-a007-4043-ae13-f38fb2b9eb7b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:36.370976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 110/222] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:36 2022] GET /identity/v3/users/6cafd0f9f2f34178aa343385780d84ce => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:36.377272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70034cbe-a007-4043-ae13-f38fb2b9eb7b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:36.464272 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead42bf-bc14-4647-b857-f7d3248389f7 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:36.503631 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70034cbe-a007-4043-ae13-f38fb2b9eb7b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:36.506085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bd9a2-495a-471b-9296-1c027ef1c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:36.507506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bd9a2-495a-471b-9296-1c027ef1c2ac None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:36.508019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bd9a2-495a-471b-9296-1c027ef1c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:36.508511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bd9a2-495a-471b-9296-1c027ef1c2ac None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:36.510026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bd9a2-495a-471b-9296-1c027ef1c2ac None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:36.511977 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bd9a2-495a-471b-9296-1c027ef1c2ac None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:36.513924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 113/223] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:36 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:36.515418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52ebd-0f88-4f8a-9eec-c9deb2c76da8 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:36.515908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52ebd-0f88-4f8a-9eec-c9deb2c76da8 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:36.516372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52ebd-0f88-4f8a-9eec-c9deb2c76da8 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:36.518586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 114/224] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:36.521191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52ebd-0f88-4f8a-9eec-c9deb2c76da8 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:36.540991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55acd2-028a-4de6-b666-9c460c76af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:36.541638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55acd2-028a-4de6-b666-9c460c76af06 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:36.541908 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55acd2-028a-4de6-b666-9c460c76af06 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:36.542172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55acd2-028a-4de6-b666-9c460c76af06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:36.622192 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55acd2-028a-4de6-b666-9c460c76af06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:36.624231 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55acd2-028a-4de6-b666-9c460c76af06 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:36.625920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52ebd-0f88-4f8a-9eec-c9deb2c76da8 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:36.662018 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ceb04-1d19-451e-bf9f-b2eed6da8b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:36.663131 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ceb04-1d19-451e-bf9f-b2eed6da8b0b None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:36.663419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ceb04-1d19-451e-bf9f-b2eed6da8b0b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:36.664464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ceb04-1d19-451e-bf9f-b2eed6da8b0b None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94/users/a80a7680c0534b3481d2b562acdc1bfe/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:36.666490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ceb04-1d19-451e-bf9f-b2eed6da8b0b None admin] RBAC: Authorizing `identity:create_grant(project_id=c02cb7cef6b84d34815a0826d3396e94, user_id=a80a7680c0534b3481d2b562acdc1bfe, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:36.667959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ceb04-1d19-451e-bf9f-b2eed6da8b0b None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:36.686158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 115/225] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:24:36 2022] PUT /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94/users/a80a7680c0534b3481d2b562acdc1bfe/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:24:36.687566 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e811826-2182-4fbe-bdd7-5d4ae97b14ce None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:36.687851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e811826-2182-4fbe-bdd7-5d4ae97b14ce None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:36.688170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e811826-2182-4fbe-bdd7-5d4ae97b14ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:36.708382 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-8e811826-2182-4fbe-bdd7-5d4ae97b14ce None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:36.709652 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8e811826-2182-4fbe-bdd7-5d4ae97b14ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:36.750451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 111/226] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:36.756321 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55acd2-028a-4de6-b666-9c460c76af06 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:36.823072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 116/227] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:36.854809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e811826-2182-4fbe-bdd7-5d4ae97b14ce None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:36.897683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55acd2-028a-4de6-b666-9c460c76af06 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:36.934505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929a77-e056-4661-822a-9982ca6ab4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:36.935393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929a77-e056-4661-822a-9982ca6ab4ce None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:36.935668 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929a77-e056-4661-822a-9982ca6ab4ce None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:36.935992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929a77-e056-4661-822a-9982ca6ab4ce None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:36.937232 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3929a77-e056-4661-822a-9982ca6ab4ce None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:36.938680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3929a77-e056-4661-822a-9982ca6ab4ce None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:36.940812 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 112/228] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:36 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:36.946508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929a77-e056-4661-822a-9982ca6ab4ce None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:36.983720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e811826-2182-4fbe-bdd7-5d4ae97b14ce None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:37.028043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ec255-545c-4c43-85f7-7e9cf7b1e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:37.028855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec255-545c-4c43-85f7-7e9cf7b1e060 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:37.029137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec255-545c-4c43-85f7-7e9cf7b1e060 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:37.029407 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec255-545c-4c43-85f7-7e9cf7b1e060 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:37.043336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ec255-545c-4c43-85f7-7e9cf7b1e060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:37.051693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-e43ec255-545c-4c43-85f7-7e9cf7b1e060 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:24:37.052893 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 117/229] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:24:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:24:37.059668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ec255-545c-4c43-85f7-7e9cf7b1e060 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:37.059801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929a77-e056-4661-822a-9982ca6ab4ce None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:37.107613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884606e9-636c-4c6a-8e51-a56e0859f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:37.108278 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884606e9-636c-4c6a-8e51-a56e0859f265 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:37.108551 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884606e9-636c-4c6a-8e51-a56e0859f265 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:37.108824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884606e9-636c-4c6a-8e51-a56e0859f265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:37.109653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884606e9-636c-4c6a-8e51-a56e0859f265 None admin] RBAC: Adding query filter params (role.id=f8641f824b324fa2956c5fc5b764f8ae, scope.project.id=c02cb7cef6b84d34815a0826d3396e94, user.id=6cafd0f9f2f34178aa343385780d84ce) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:37.109963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884606e9-636c-4c6a-8e51-a56e0859f265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:37.113249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884606e9-636c-4c6a-8e51-a56e0859f265 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:37.121159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 113/230] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:36 2022] GET /identity/v3/role_assignments?user.id=6cafd0f9f2f34178aa343385780d84ce&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:37.210039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ec255-545c-4c43-85f7-7e9cf7b1e060 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:37.252724 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54d183-5fe3-4d5d-8782-1f37d81f659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:37.253786 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d183-5fe3-4d5d-8782-1f37d81f659c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:37.254289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d183-5fe3-4d5d-8782-1f37d81f659c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:37.254754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d183-5fe3-4d5d-8782-1f37d81f659c None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:37.255738 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54d183-5fe3-4d5d-8782-1f37d81f659c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:37.256256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54d183-5fe3-4d5d-8782-1f37d81f659c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:37.257961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54d183-5fe3-4d5d-8782-1f37d81f659c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:37.267911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 118/231] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:24:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:37.274958 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884606e9-636c-4c6a-8e51-a56e0859f265 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:37.418328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884606e9-636c-4c6a-8e51-a56e0859f265 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:37.461364 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8ecf8-f435-427e-99e3-d4c8f0ad5797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:37.462159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8ecf8-f435-427e-99e3-d4c8f0ad5797 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:37.462433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8ecf8-f435-427e-99e3-d4c8f0ad5797 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:37.462704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8ecf8-f435-427e-99e3-d4c8f0ad5797 None admin] PATH_INFO: `/v3/users/a80a7680c0534b3481d2b562acdc1bfe` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:37.463976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8ecf8-f435-427e-99e3-d4c8f0ad5797 None admin] RBAC: Authorizing `identity:get_user(user_id=a80a7680c0534b3481d2b562acdc1bfe)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:37.465436 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8ecf8-f435-427e-99e3-d4c8f0ad5797 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:37.467395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 114/232] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:37 2022] GET /identity/v3/users/a80a7680c0534b3481d2b562acdc1bfe => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:37.473856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54d183-5fe3-4d5d-8782-1f37d81f659c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:37.621624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54d183-5fe3-4d5d-8782-1f37d81f659c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:37.657184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cc48d-f268-470b-b3c0-712c564505ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:37.658580 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc48d-f268-470b-b3c0-712c564505ee None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:37.658862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc48d-f268-470b-b3c0-712c564505ee None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:37.659160 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc48d-f268-470b-b3c0-712c564505ee None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:37.660376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cc48d-f268-470b-b3c0-712c564505ee None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:37.661836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cc48d-f268-470b-b3c0-712c564505ee None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:37.663565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 119/233] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:37 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:37.669294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8ecf8-f435-427e-99e3-d4c8f0ad5797 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:37.793299 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8ecf8-f435-427e-99e3-d4c8f0ad5797 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:37.841268 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573985c-f8fd-4608-b884-85feb42a647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:37.842499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573985c-f8fd-4608-b884-85feb42a647c None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:37.842995 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573985c-f8fd-4608-b884-85feb42a647c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:37.843462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573985c-f8fd-4608-b884-85feb42a647c None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94/users/a80a7680c0534b3481d2b562acdc1bfe/roles/79396755fc0842a882775515d6feab13` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:37.848604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573985c-f8fd-4608-b884-85feb42a647c None admin] RBAC: Authorizing `identity:create_grant(project_id=c02cb7cef6b84d34815a0826d3396e94, user_id=a80a7680c0534b3481d2b562acdc1bfe, role_id=79396755fc0842a882775515d6feab13)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:37.850232 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573985c-f8fd-4608-b884-85feb42a647c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:37.868208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 115/234] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:24:37 2022] PUT /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94/users/a80a7680c0534b3481d2b562acdc1bfe/roles/79396755fc0842a882775515d6feab13 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:24:38.971408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160849b2-cf4d-456f-b62b-fbfadef1b0b9 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:38.971951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160849b2-cf4d-456f-b62b-fbfadef1b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:38.971951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160849b2-cf4d-456f-b62b-fbfadef1b0b9 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:38.973980 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 120/235] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:38.979214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea757d-c40d-493e-bef3-721245c1b992 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:38.980058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea757d-c40d-493e-bef3-721245c1b992 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:38.980550 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea757d-c40d-493e-bef3-721245c1b992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:38.997627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-bdea757d-c40d-493e-bef3-721245c1b992 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:38.999141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-bdea757d-c40d-493e-bef3-721245c1b992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:39.066922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 116/236] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:39.090766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160849b2-cf4d-456f-b62b-fbfadef1b0b9 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:39.225267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160849b2-cf4d-456f-b62b-fbfadef1b0b9 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:39.268154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f479b5-d2bf-448f-ba9c-7e28b77e4167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:39.268947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f479b5-d2bf-448f-ba9c-7e28b77e4167 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:39.269231 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f479b5-d2bf-448f-ba9c-7e28b77e4167 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:39.269504 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f479b5-d2bf-448f-ba9c-7e28b77e4167 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:39.281147 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f479b5-d2bf-448f-ba9c-7e28b77e4167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:39.291590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-96f479b5-d2bf-448f-ba9c-7e28b77e4167 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:24:39.291722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7d89-a4fa-47b4-9ca5-512bf2cd0147 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:39.291901 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7d89-a4fa-47b4-9ca5-512bf2cd0147 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:39.292151 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7d89-a4fa-47b4-9ca5-512bf2cd0147 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:39.292823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 121/237] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:39.294478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 117/238] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:39.299048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f479b5-d2bf-448f-ba9c-7e28b77e4167 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:39.302073 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9ba94-2c34-453d-a70d-4b80823e02ab None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:39.302361 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9ba94-2c34-453d-a70d-4b80823e02ab None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:39.302635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9ba94-2c34-453d-a70d-4b80823e02ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:39.327270 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-5fe9ba94-2c34-453d-a70d-4b80823e02ab None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:39.328497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5fe9ba94-2c34-453d-a70d-4b80823e02ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:39.462733 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 118/239] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Feb 28 10:24:39.483387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f479b5-d2bf-448f-ba9c-7e28b77e4167 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:39.516060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9ba94-2c34-453d-a70d-4b80823e02ab None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:39.529317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176ec43-7735-48f7-9daa-4c8b65393c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:39.530035 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176ec43-7735-48f7-9daa-4c8b65393c68 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:39.530318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176ec43-7735-48f7-9daa-4c8b65393c68 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:39.530591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176ec43-7735-48f7-9daa-4c8b65393c68 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:39.533925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176ec43-7735-48f7-9daa-4c8b65393c68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:39.534257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176ec43-7735-48f7-9daa-4c8b65393c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:39.536863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176ec43-7735-48f7-9daa-4c8b65393c68 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:39.554055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 122/240] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:39.576579 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176ec43-7735-48f7-9daa-4c8b65393c68 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:39.657288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9ba94-2c34-453d-a70d-4b80823e02ab None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:39.692180 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e65c9e-a6ee-4959-b632-aa760592111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:39.693023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65c9e-a6ee-4959-b632-aa760592111a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:39.693305 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65c9e-a6ee-4959-b632-aa760592111a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:39.693579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65c9e-a6ee-4959-b632-aa760592111a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:39.694756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e65c9e-a6ee-4959-b632-aa760592111a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:39.696247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e65c9e-a6ee-4959-b632-aa760592111a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:39.697930 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 119/241] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:39.703319 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e65c9e-a6ee-4959-b632-aa760592111a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:39.765806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176ec43-7735-48f7-9daa-4c8b65393c68 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:39.803194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb62f9-c4c9-4401-a4a8-5d7771b56e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:39.804448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb62f9-c4c9-4401-a4a8-5d7771b56e9c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:39.804959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb62f9-c4c9-4401-a4a8-5d7771b56e9c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:39.805429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb62f9-c4c9-4401-a4a8-5d7771b56e9c None admin] PATH_INFO: `/v3/users/d14ae1e0c0074c808735654b73d34176` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:39.820025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb62f9-c4c9-4401-a4a8-5d7771b56e9c None admin] RBAC: Authorizing `identity:get_user(user_id=d14ae1e0c0074c808735654b73d34176)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:39.821805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb62f9-c4c9-4401-a4a8-5d7771b56e9c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:39.823759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 123/242] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:39 2022] GET /identity/v3/users/d14ae1e0c0074c808735654b73d34176 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:39.825318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae062c4-9653-477c-a180-342e25e85cb9 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:39.825803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae062c4-9653-477c-a180-342e25e85cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:39.826312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae062c4-9653-477c-a180-342e25e85cb9 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:39.828337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 124/243] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:39.835117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae062c4-9653-477c-a180-342e25e85cb9 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:39.843471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e65c9e-a6ee-4959-b632-aa760592111a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:39.878723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed517d-f15d-4158-af97-129a60b81446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:39.879479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed517d-f15d-4158-af97-129a60b81446 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:39.879757 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed517d-f15d-4158-af97-129a60b81446 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:39.880078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed517d-f15d-4158-af97-129a60b81446 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:39.880796 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed517d-f15d-4158-af97-129a60b81446 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:39.882255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed517d-f15d-4158-af97-129a60b81446 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:39.906711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 120/244] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:24:39 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:24:39.912188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89f5a-69fe-4f83-adae-a24854dd2be8 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:39.912830 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89f5a-69fe-4f83-adae-a24854dd2be8 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:39.913305 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89f5a-69fe-4f83-adae-a24854dd2be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:39.951575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-13f89f5a-69fe-4f83-adae-a24854dd2be8 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:39.957027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-13f89f5a-69fe-4f83-adae-a24854dd2be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:39.985589 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae062c4-9653-477c-a180-342e25e85cb9 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:40.057239 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d489c00-b1ea-4cfd-b16e-b83c83bf518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:40.058233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d489c00-b1ea-4cfd-b16e-b83c83bf518e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.058712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d489c00-b1ea-4cfd-b16e-b83c83bf518e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.059238 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d489c00-b1ea-4cfd-b16e-b83c83bf518e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.095185 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 121/245] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:40.136289 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f89f5a-69fe-4f83-adae-a24854dd2be8 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:40.183544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d489c00-b1ea-4cfd-b16e-b83c83bf518e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:40.185607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d489c00-b1ea-4cfd-b16e-b83c83bf518e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:40.246423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f89f5a-69fe-4f83-adae-a24854dd2be8 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:40.288931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dc1eb-55d8-4c1a-abc6-e87d21f884eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:40.289743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dc1eb-55d8-4c1a-abc6-e87d21f884eb None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.290023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dc1eb-55d8-4c1a-abc6-e87d21f884eb None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.290353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dc1eb-55d8-4c1a-abc6-e87d21f884eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.302815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0dc1eb-55d8-4c1a-abc6-e87d21f884eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:40.309965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-6f0dc1eb-55d8-4c1a-abc6-e87d21f884eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:24:40.311427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 122/246] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:24:40.312876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 125/247] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:40.313463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05413c38-3e7d-47fc-acfc-986aeabdf2a4 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.314111 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05413c38-3e7d-47fc-acfc-986aeabdf2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.314578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05413c38-3e7d-47fc-acfc-986aeabdf2a4 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.316549 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 123/248] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:40.319018 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d489c00-b1ea-4cfd-b16e-b83c83bf518e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:40.320126 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05413c38-3e7d-47fc-acfc-986aeabdf2a4 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:40.437742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d489c00-b1ea-4cfd-b16e-b83c83bf518e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:40.456760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05413c38-3e7d-47fc-acfc-986aeabdf2a4 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:40.474168 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446f288-0bb3-4a1c-802e-924080a1fa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:40.474664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446f288-0bb3-4a1c-802e-924080a1fa10 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.474971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446f288-0bb3-4a1c-802e-924080a1fa10 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.475249 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446f288-0bb3-4a1c-802e-924080a1fa10 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.475984 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446f288-0bb3-4a1c-802e-924080a1fa10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:40.476291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446f288-0bb3-4a1c-802e-924080a1fa10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:40.477721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446f288-0bb3-4a1c-802e-924080a1fa10 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:40.487933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 126/249] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:40.494318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf2b1-a3c6-4204-b659-1038f0bba46c None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.494647 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf2b1-a3c6-4204-b659-1038f0bba46c None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.494878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf2b1-a3c6-4204-b659-1038f0bba46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.498567 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2b9ef-b96d-4994-ac4b-fea22ae41e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:40.499685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2b9ef-b96d-4994-ac4b-fea22ae41e70 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.500301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2b9ef-b96d-4994-ac4b-fea22ae41e70 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.500764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2b9ef-b96d-4994-ac4b-fea22ae41e70 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.503095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2b9ef-b96d-4994-ac4b-fea22ae41e70 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:40.504805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2b9ef-b96d-4994-ac4b-fea22ae41e70 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:40.507457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 124/250] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:40 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:40.508525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2b9ef-b96d-4994-ac4b-fea22ae41e70 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:40.517268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-a7acf2b1-a3c6-4204-b659-1038f0bba46c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:40.518705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a7acf2b1-a3c6-4204-b659-1038f0bba46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:40.604990 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 127/251] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:40.606533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acf2b1-a3c6-4204-b659-1038f0bba46c None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:40.636597 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2b9ef-b96d-4994-ac4b-fea22ae41e70 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:40.703595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b4c7-c6c3-406c-a435-aa297f54712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:40.704554 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b4c7-c6c3-406c-a435-aa297f54712d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.704804 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b4c7-c6c3-406c-a435-aa297f54712d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.705075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b4c7-c6c3-406c-a435-aa297f54712d None admin] PATH_INFO: `/v3/users/a80a7680c0534b3481d2b562acdc1bfe` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.706405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b4c7-c6c3-406c-a435-aa297f54712d None admin] RBAC: Authorizing `identity:get_user(user_id=a80a7680c0534b3481d2b562acdc1bfe)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:40.707884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b4c7-c6c3-406c-a435-aa297f54712d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:40.711550 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 125/252] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:40 2022] GET /identity/v3/users/a80a7680c0534b3481d2b562acdc1bfe => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:40.712329 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b4c7-c6c3-406c-a435-aa297f54712d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:40.779711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acf2b1-a3c6-4204-b659-1038f0bba46c None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:40.816227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d6878-9a8c-4c9c-b13d-47f36630f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:40.816881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d6878-9a8c-4c9c-b13d-47f36630f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.817163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d6878-9a8c-4c9c-b13d-47f36630f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.817596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d6878-9a8c-4c9c-b13d-47f36630f7b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.818517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d6878-9a8c-4c9c-b13d-47f36630f7b1 None admin] RBAC: Adding query filter params (role.id=1b0597a6df10450bb5b56ed2c8b6261d, scope.project.id=c02cb7cef6b84d34815a0826d3396e94, user.id=d14ae1e0c0074c808735654b73d34176) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:40.818833 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d6878-9a8c-4c9c-b13d-47f36630f7b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:40.820843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d6878-9a8c-4c9c-b13d-47f36630f7b1 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:40.827584 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 128/253] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:40 2022] GET /identity/v3/role_assignments?user.id=d14ae1e0c0074c808735654b73d34176&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=1b0597a6df10450bb5b56ed2c8b6261d => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:40.828371 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d6878-9a8c-4c9c-b13d-47f36630f7b1 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:40.846018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b4c7-c6c3-406c-a435-aa297f54712d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:40.884384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c103d3-e39f-4935-8cef-c7ba13766aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:40.885829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c103d3-e39f-4935-8cef-c7ba13766aaa None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.886301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c103d3-e39f-4935-8cef-c7ba13766aaa None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.886798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c103d3-e39f-4935-8cef-c7ba13766aaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.902641 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c103d3-e39f-4935-8cef-c7ba13766aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:40.912767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-f1c103d3-e39f-4935-8cef-c7ba13766aaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:40.914698 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 126/254] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:40.918369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd348-0517-43a6-9d61-a9e2e5e36eda None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.919001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd348-0517-43a6-9d61-a9e2e5e36eda None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.919505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd348-0517-43a6-9d61-a9e2e5e36eda None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.926546 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 127/255] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:40.929659 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cd348-0517-43a6-9d61-a9e2e5e36eda None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:41.035639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d6878-9a8c-4c9c-b13d-47f36630f7b1 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:41.075392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27286c-a749-4aa5-bf4b-fc14c92a1a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:41.076040 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27286c-a749-4aa5-bf4b-fc14c92a1a42 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:41.076319 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27286c-a749-4aa5-bf4b-fc14c92a1a42 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:41.076588 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27286c-a749-4aa5-bf4b-fc14c92a1a42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:41.111976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cd348-0517-43a6-9d61-a9e2e5e36eda None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:41.153315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7e11a-703e-4fb1-b12f-e8f20f8c5863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:41.154203 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7e11a-703e-4fb1-b12f-e8f20f8c5863 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:41.154774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7e11a-703e-4fb1-b12f-e8f20f8c5863 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:41.155309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7e11a-703e-4fb1-b12f-e8f20f8c5863 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:41.156497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7e11a-703e-4fb1-b12f-e8f20f8c5863 None admin] RBAC: Adding query filter params (name=member) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:41.156964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7e11a-703e-4fb1-b12f-e8f20f8c5863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:41.159430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7e11a-703e-4fb1-b12f-e8f20f8c5863 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:41.169047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27286c-a749-4aa5-bf4b-fc14c92a1a42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:41.170312 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 128/256] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:41.174834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27286c-a749-4aa5-bf4b-fc14c92a1a42 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:41.174987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486fa5c-8668-448f-9d72-445ed25c14f2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:41.174987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486fa5c-8668-448f-9d72-445ed25c14f2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:41.174987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486fa5c-8668-448f-9d72-445ed25c14f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:41.194891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a486fa5c-8668-448f-9d72-445ed25c14f2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:41.196458 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a486fa5c-8668-448f-9d72-445ed25c14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:41.321729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 129/257] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:41.322598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486fa5c-8668-448f-9d72-445ed25c14f2 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:41.369088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 129/258] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:41.369951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27286c-a749-4aa5-bf4b-fc14c92a1a42 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:41.487969 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27286c-a749-4aa5-bf4b-fc14c92a1a42 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:41.523460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae13be8-f06c-4798-bfbd-18cd266f7159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:41.524263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae13be8-f06c-4798-bfbd-18cd266f7159 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:41.524547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae13be8-f06c-4798-bfbd-18cd266f7159 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:41.524822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae13be8-f06c-4798-bfbd-18cd266f7159 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:41.535072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae13be8-f06c-4798-bfbd-18cd266f7159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:41.537205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486fa5c-8668-448f-9d72-445ed25c14f2 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:41.542237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-eae13be8-f06c-4798-bfbd-18cd266f7159 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:24:41.543773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 130/259] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:24:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:41.544565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae13be8-f06c-4798-bfbd-18cd266f7159 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:41.610738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974edc9-97d5-404b-8016-63ee20ea878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:41.611640 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974edc9-97d5-404b-8016-63ee20ea878e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:41.611921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974edc9-97d5-404b-8016-63ee20ea878e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:41.612195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974edc9-97d5-404b-8016-63ee20ea878e None admin] PATH_INFO: `/v3/users/6cafd0f9f2f34178aa343385780d84ce` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:41.618850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974edc9-97d5-404b-8016-63ee20ea878e None admin] RBAC: Authorizing `identity:get_user(user_id=6cafd0f9f2f34178aa343385780d84ce)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:41.618850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974edc9-97d5-404b-8016-63ee20ea878e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:41.619521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 130/260] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:41 2022] GET /identity/v3/users/6cafd0f9f2f34178aa343385780d84ce => generated 297 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:41.620452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974edc9-97d5-404b-8016-63ee20ea878e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:41.678204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae13be8-f06c-4798-bfbd-18cd266f7159 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:41.712399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c081cb7-be71-42c5-aab1-2bbd6812f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:41.712987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c081cb7-be71-42c5-aab1-2bbd6812f184 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:41.713270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c081cb7-be71-42c5-aab1-2bbd6812f184 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:41.713546 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c081cb7-be71-42c5-aab1-2bbd6812f184 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:41.714750 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c081cb7-be71-42c5-aab1-2bbd6812f184 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:41.716233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c081cb7-be71-42c5-aab1-2bbd6812f184 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:41.718103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 131/261] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:41 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:41.718674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c081cb7-be71-42c5-aab1-2bbd6812f184 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:41.726579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974edc9-97d5-404b-8016-63ee20ea878e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:41.800410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9c71-3b27-4326-937a-2b54fc3f69a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:41.801018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9c71-3b27-4326-937a-2b54fc3f69a0 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:41.801296 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9c71-3b27-4326-937a-2b54fc3f69a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:41.801571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9c71-3b27-4326-937a-2b54fc3f69a0 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:41.802315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba9c71-3b27-4326-937a-2b54fc3f69a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:41.802675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba9c71-3b27-4326-937a-2b54fc3f69a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:41.804156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba9c71-3b27-4326-937a-2b54fc3f69a0 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:41.818997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c081cb7-be71-42c5-aab1-2bbd6812f184 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:41.825057 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 131/262] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:24:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:41.825702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9c71-3b27-4326-937a-2b54fc3f69a0 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:41.852908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a5490-de88-45e5-ac09-cb7c16b68769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:41.853761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a5490-de88-45e5-ac09-cb7c16b68769 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:41.854042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a5490-de88-45e5-ac09-cb7c16b68769 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:41.854321 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a5490-de88-45e5-ac09-cb7c16b68769 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:41.855529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a5490-de88-45e5-ac09-cb7c16b68769 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:41.856999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a5490-de88-45e5-ac09-cb7c16b68769 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:41.858921 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 132/263] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:41 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:41.859490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a5490-de88-45e5-ac09-cb7c16b68769 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:41.944681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9c71-3b27-4326-937a-2b54fc3f69a0 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:41.959005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a5490-de88-45e5-ac09-cb7c16b68769 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:41.978315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9e143-8663-4342-a667-3be970200de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:41.979318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9e143-8663-4342-a667-3be970200de2 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:41.979815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9e143-8663-4342-a667-3be970200de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:41.980276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9e143-8663-4342-a667-3be970200de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:41.981283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9e143-8663-4342-a667-3be970200de2 None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=c02cb7cef6b84d34815a0826d3396e94, user.id=a80a7680c0534b3481d2b562acdc1bfe) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:41.981784 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9e143-8663-4342-a667-3be970200de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:41.983461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9e143-8663-4342-a667-3be970200de2 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:41.995003 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 132/264] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:41 2022] GET /identity/v3/role_assignments?user.id=a80a7680c0534b3481d2b562acdc1bfe&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:41.996446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9e143-8663-4342-a667-3be970200de2 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:41.999645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9f315-e854-4066-98fe-58d5b17cb523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:42.002556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f315-e854-4066-98fe-58d5b17cb523 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:42.003142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f315-e854-4066-98fe-58d5b17cb523 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:42.003615 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f315-e854-4066-98fe-58d5b17cb523 None admin] PATH_INFO: `/v3/users/a80a7680c0534b3481d2b562acdc1bfe` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:42.005133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9f315-e854-4066-98fe-58d5b17cb523 None admin] RBAC: Authorizing `identity:get_user(user_id=a80a7680c0534b3481d2b562acdc1bfe)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:42.006790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9f315-e854-4066-98fe-58d5b17cb523 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:42.014367 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 133/265] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:41 2022] GET /identity/v3/users/a80a7680c0534b3481d2b562acdc1bfe => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:42.021380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9f315-e854-4066-98fe-58d5b17cb523 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:42.231015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9e143-8663-4342-a667-3be970200de2 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:42.235725 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9f315-e854-4066-98fe-58d5b17cb523 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:42.286600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a4b90-c6e7-4409-ab97-471ade12706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:42.287688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a4b90-c6e7-4409-ab97-471ade12706f None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:42.287983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a4b90-c6e7-4409-ab97-471ade12706f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:42.288259 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a4b90-c6e7-4409-ab97-471ade12706f None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94/users/6cafd0f9f2f34178aa343385780d84ce/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:42.291061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a4b90-c6e7-4409-ab97-471ade12706f None admin] RBAC: Authorizing `identity:create_grant(project_id=c02cb7cef6b84d34815a0826d3396e94, user_id=6cafd0f9f2f34178aa343385780d84ce, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:42.292828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a4b90-c6e7-4409-ab97-471ade12706f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:42.302019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202a537-1e4b-49ef-9db0-12826dd9d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:42.302736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202a537-1e4b-49ef-9db0-12826dd9d058 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:42.303057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202a537-1e4b-49ef-9db0-12826dd9d058 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:42.303338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202a537-1e4b-49ef-9db0-12826dd9d058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:42.319158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 133/266] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:24:41 2022] PUT /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94/users/6cafd0f9f2f34178aa343385780d84ce/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:24:42.387529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202a537-1e4b-49ef-9db0-12826dd9d058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:42.389020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202a537-1e4b-49ef-9db0-12826dd9d058 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:42.498126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 134/267] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:42.504290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a4b90-c6e7-4409-ab97-471ade12706f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:42.638242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a4b90-c6e7-4409-ab97-471ade12706f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:42.671512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f80fe-a63d-4cfc-b0fa-49fc46a105ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:42.672367 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f80fe-a63d-4cfc-b0fa-49fc46a105ea None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:42.672645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f80fe-a63d-4cfc-b0fa-49fc46a105ea None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:42.672917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f80fe-a63d-4cfc-b0fa-49fc46a105ea None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:42.674697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f80fe-a63d-4cfc-b0fa-49fc46a105ea None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:42.676216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f80fe-a63d-4cfc-b0fa-49fc46a105ea None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:42.678259 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 134/268] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:42 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:42.684010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202a537-1e4b-49ef-9db0-12826dd9d058 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:42.794490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202a537-1e4b-49ef-9db0-12826dd9d058 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:42.834041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439edbe-a6e9-4bae-ac8f-47f7857c6d27 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:42.834387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439edbe-a6e9-4bae-ac8f-47f7857c6d27 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:42.834664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439edbe-a6e9-4bae-ac8f-47f7857c6d27 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:42.836531 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b6e3-0bdf-48bd-ad98-368a8d718566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:42.836843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 135/269] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:24:42.837265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b6e3-0bdf-48bd-ad98-368a8d718566 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:42.837548 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b6e3-0bdf-48bd-ad98-368a8d718566 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:42.837819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b6e3-0bdf-48bd-ad98-368a8d718566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:42.838707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725b6e3-0bdf-48bd-ad98-368a8d718566 None admin] RBAC: Adding query filter params (role.id=79396755fc0842a882775515d6feab13, scope.project.id=c02cb7cef6b84d34815a0826d3396e94, user.id=a80a7680c0534b3481d2b562acdc1bfe) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:42.839090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725b6e3-0bdf-48bd-ad98-368a8d718566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:42.840888 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725b6e3-0bdf-48bd-ad98-368a8d718566 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:42.842311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa45105-8192-4c52-a851-a17acf7414cd None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:42.842600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa45105-8192-4c52-a851-a17acf7414cd None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:42.842880 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa45105-8192-4c52-a851-a17acf7414cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:42.849573 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 135/270] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:42 2022] GET /identity/v3/role_assignments?user.id=a80a7680c0534b3481d2b562acdc1bfe&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=79396755fc0842a882775515d6feab13 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:42.862500 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-3fa45105-8192-4c52-a851-a17acf7414cd None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:42.864161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3fa45105-8192-4c52-a851-a17acf7414cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:42.949180 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 136/271] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:42.979282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b6e3-0bdf-48bd-ad98-368a8d718566 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:43.112493 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b6e3-0bdf-48bd-ad98-368a8d718566 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:43.147626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4790e-79a2-4510-8c20-62d06ac002a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:43.148418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4790e-79a2-4510-8c20-62d06ac002a1 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:43.148698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4790e-79a2-4510-8c20-62d06ac002a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:43.148973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4790e-79a2-4510-8c20-62d06ac002a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:43.159203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4790e-79a2-4510-8c20-62d06ac002a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:43.166156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-1ca4790e-79a2-4510-8c20-62d06ac002a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:43.167683 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 136/272] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:43.174209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa45105-8192-4c52-a851-a17acf7414cd None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:43.280115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91af54-476d-46c1-82ca-2c26391835a8 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:43.280610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91af54-476d-46c1-82ca-2c26391835a8 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:43.280610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91af54-476d-46c1-82ca-2c26391835a8 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:43.282525 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 137/273] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:43.283719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa45105-8192-4c52-a851-a17acf7414cd None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:43.288336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ebba3-a9c8-44cc-8d53-c80a60b6daa8 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:43.288627 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ebba3-a9c8-44cc-8d53-c80a60b6daa8 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:43.288901 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ebba3-a9c8-44cc-8d53-c80a60b6daa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:43.309282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-7a8ebba3-a9c8-44cc-8d53-c80a60b6daa8 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:43.310777 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7a8ebba3-a9c8-44cc-8d53-c80a60b6daa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:43.325720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf788e-706d-442f-a927-aabde4e6819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:43.326284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf788e-706d-442f-a927-aabde4e6819a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:43.326561 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf788e-706d-442f-a927-aabde4e6819a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:43.326831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf788e-706d-442f-a927-aabde4e6819a None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:43.327819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf788e-706d-442f-a927-aabde4e6819a None admin] RBAC: Adding query filter params (name=member) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:43.327947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf788e-706d-442f-a927-aabde4e6819a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:43.329282 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf788e-706d-442f-a927-aabde4e6819a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:43.338774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 137/274] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:43.346946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf788e-706d-442f-a927-aabde4e6819a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:43.390063 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 138/275] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:43.416110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ebba3-a9c8-44cc-8d53-c80a60b6daa8 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:43.460432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf788e-706d-442f-a927-aabde4e6819a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:43.511773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588d30d-116c-43ee-ad18-5e7ea8945e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:43.512666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588d30d-116c-43ee-ad18-5e7ea8945e82 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:43.512942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588d30d-116c-43ee-ad18-5e7ea8945e82 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:43.513208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588d30d-116c-43ee-ad18-5e7ea8945e82 None admin] PATH_INFO: `/v3/users/c55fa2e18bf741d18e3400b1f2b4e84c` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:43.534245 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588d30d-116c-43ee-ad18-5e7ea8945e82 None admin] RBAC: Authorizing `identity:get_user(user_id=c55fa2e18bf741d18e3400b1f2b4e84c)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:43.536146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588d30d-116c-43ee-ad18-5e7ea8945e82 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:43.538070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 138/276] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:43 2022] GET /identity/v3/users/c55fa2e18bf741d18e3400b1f2b4e84c => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:43.543764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588d30d-116c-43ee-ad18-5e7ea8945e82 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:43.545514 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ebba3-a9c8-44cc-8d53-c80a60b6daa8 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:43.580157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ec0e-5ac2-4c09-bd20-c4ce3b2d7e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:43.580641 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ec0e-5ac2-4c09-bd20-c4ce3b2d7e45 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:43.580920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ec0e-5ac2-4c09-bd20-c4ce3b2d7e45 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:43.581207 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ec0e-5ac2-4c09-bd20-c4ce3b2d7e45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:43.582348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ec0e-5ac2-4c09-bd20-c4ce3b2d7e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:43.583822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ec0e-5ac2-4c09-bd20-c4ce3b2d7e45 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:43.585727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 139/277] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:43.594300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ec0e-5ac2-4c09-bd20-c4ce3b2d7e45 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:43.647095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588d30d-116c-43ee-ad18-5e7ea8945e82 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:43.685434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b56fe8-3d66-4292-a5b8-fff172649124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:43.686871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b56fe8-3d66-4292-a5b8-fff172649124 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:43.687379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b56fe8-3d66-4292-a5b8-fff172649124 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:43.688209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b56fe8-3d66-4292-a5b8-fff172649124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:43.690108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b56fe8-3d66-4292-a5b8-fff172649124 None admin] RBAC: Adding query filter params (role.id=f8641f824b324fa2956c5fc5b764f8ae, user.id=c55fa2e18bf741d18e3400b1f2b4e84c, scope.system=all) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:43.690914 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b56fe8-3d66-4292-a5b8-fff172649124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:43.693082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b56fe8-3d66-4292-a5b8-fff172649124 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:43.699898 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 139/278] 10.222.0.44 () {56 vars in 1308 bytes} [Mon Feb 28 10:24:43 2022] GET /identity/v3/role_assignments?user.id=c55fa2e18bf741d18e3400b1f2b4e84c&scope.system=all&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:43.713505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ec0e-5ac2-4c09-bd20-c4ce3b2d7e45 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:43.752801 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e3aed-dfc2-43cd-a874-fac67e6c5ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:43.753485 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e3aed-dfc2-43cd-a874-fac67e6c5ca5 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:43.753767 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e3aed-dfc2-43cd-a874-fac67e6c5ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:43.754037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e3aed-dfc2-43cd-a874-fac67e6c5ca5 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:43.754766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e3aed-dfc2-43cd-a874-fac67e6c5ca5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:43.756269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e3aed-dfc2-43cd-a874-fac67e6c5ca5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:43.783182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 140/279] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:24:43 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:24:43.875018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d0820-4365-496f-8b6f-3c2913d1966f None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:43.875676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d0820-4365-496f-8b6f-3c2913d1966f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:43.876693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d0820-4365-496f-8b6f-3c2913d1966f None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:43.878845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 140/280] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:43.885037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9006614-010e-42d7-8849-8712abcc85d7 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:43.885930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9006614-010e-42d7-8849-8712abcc85d7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:43.886408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9006614-010e-42d7-8849-8712abcc85d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:43.905361 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f9006614-010e-42d7-8849-8712abcc85d7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:43.906933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f9006614-010e-42d7-8849-8712abcc85d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:43.979861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 141/281] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:44.002173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d0820-4365-496f-8b6f-3c2913d1966f None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:44.116201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d0820-4365-496f-8b6f-3c2913d1966f None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:44.156979 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e6aa1-0056-40dd-9138-d971fef4db09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:44.158692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e6aa1-0056-40dd-9138-d971fef4db09 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:44.159205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e6aa1-0056-40dd-9138-d971fef4db09 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:44.159479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e6aa1-0056-40dd-9138-d971fef4db09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:44.171190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e6aa1-0056-40dd-9138-d971fef4db09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:44.178044 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-7c0e6aa1-0056-40dd-9138-d971fef4db09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:24:44.179283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 141/282] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:44.185354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9006614-010e-42d7-8849-8712abcc85d7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:44.299765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9006614-010e-42d7-8849-8712abcc85d7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:44.344164 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab5b1a-916e-4bd0-8319-97687c0294a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:44.344839 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab5b1a-916e-4bd0-8319-97687c0294a1 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:44.345155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab5b1a-916e-4bd0-8319-97687c0294a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:44.345431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab5b1a-916e-4bd0-8319-97687c0294a1 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:44.346177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab5b1a-916e-4bd0-8319-97687c0294a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:44.346482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab5b1a-916e-4bd0-8319-97687c0294a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:44.347890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab5b1a-916e-4bd0-8319-97687c0294a1 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:44.356637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 142/283] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:44.362213 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e6aa1-0056-40dd-9138-d971fef4db09 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:44.506176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e6aa1-0056-40dd-9138-d971fef4db09 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:44.552550 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664cc1c-c9ec-4294-a880-662ad2ed102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:44.553430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664cc1c-c9ec-4294-a880-662ad2ed102c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:44.553706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664cc1c-c9ec-4294-a880-662ad2ed102c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:44.553978 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664cc1c-c9ec-4294-a880-662ad2ed102c None admin] PATH_INFO: `/v3/users/d14ae1e0c0074c808735654b73d34176` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:44.555208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664cc1c-c9ec-4294-a880-662ad2ed102c None admin] RBAC: Authorizing `identity:get_user(user_id=d14ae1e0c0074c808735654b73d34176)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:44.556667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664cc1c-c9ec-4294-a880-662ad2ed102c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:44.558306 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 142/284] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:44 2022] GET /identity/v3/users/d14ae1e0c0074c808735654b73d34176 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:44.564636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab5b1a-916e-4bd0-8319-97687c0294a1 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:44.690129 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab5b1a-916e-4bd0-8319-97687c0294a1 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:44.726536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7e14d-4bae-4865-9e21-071a00039962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:44.727421 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e14d-4bae-4865-9e21-071a00039962 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:44.727706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e14d-4bae-4865-9e21-071a00039962 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:44.727980 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e14d-4bae-4865-9e21-071a00039962 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:44.729215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7e14d-4bae-4865-9e21-071a00039962 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:44.730729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7e14d-4bae-4865-9e21-071a00039962 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:44.732753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 143/285] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:44 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:44.743945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664cc1c-c9ec-4294-a880-662ad2ed102c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:44.869565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664cc1c-c9ec-4294-a880-662ad2ed102c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:44.916806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018f788-6309-43fa-a59d-12ff542aeb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:44.917738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018f788-6309-43fa-a59d-12ff542aeb55 None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:44.918019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018f788-6309-43fa-a59d-12ff542aeb55 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:44.918294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018f788-6309-43fa-a59d-12ff542aeb55 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94/users/d14ae1e0c0074c808735654b73d34176/roles/1b0597a6df10450bb5b56ed2c8b6261d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:44.920430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018f788-6309-43fa-a59d-12ff542aeb55 None admin] RBAC: Authorizing `identity:create_grant(project_id=c02cb7cef6b84d34815a0826d3396e94, user_id=d14ae1e0c0074c808735654b73d34176, role_id=1b0597a6df10450bb5b56ed2c8b6261d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:44.921901 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018f788-6309-43fa-a59d-12ff542aeb55 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:44.942203 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 143/286] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:24:44 2022] PUT /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94/users/d14ae1e0c0074c808735654b73d34176/roles/1b0597a6df10450bb5b56ed2c8b6261d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:24:45.128402 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72d75-f706-40af-96ce-7123908b0bfe None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:45.128602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72d75-f706-40af-96ce-7123908b0bfe None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:45.129116 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72d75-f706-40af-96ce-7123908b0bfe None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:45.131277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 144/287] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:45.137119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5219-7488-4998-9db6-f4313c486ea2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:45.137707 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5219-7488-4998-9db6-f4313c486ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:45.138188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5219-7488-4998-9db6-f4313c486ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:45.158393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-890a5219-7488-4998-9db6-f4313c486ea2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:45.159998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-890a5219-7488-4998-9db6-f4313c486ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:45.232824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 144/288] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:45.256392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef72d75-f706-40af-96ce-7123908b0bfe None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:45.380684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef72d75-f706-40af-96ce-7123908b0bfe None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:45.424704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a52d0-6e16-477b-b331-0151e46e4510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:45.425505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a52d0-6e16-477b-b331-0151e46e4510 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:45.425781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a52d0-6e16-477b-b331-0151e46e4510 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:45.426051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a52d0-6e16-477b-b331-0151e46e4510 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:45.439862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a52d0-6e16-477b-b331-0151e46e4510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:45.446750 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-b49a52d0-6e16-477b-b331-0151e46e4510 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:45.448006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 145/289] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:45.453950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a5219-7488-4998-9db6-f4313c486ea2 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:45.588734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a5219-7488-4998-9db6-f4313c486ea2 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:45.625816 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61863d6b-5c88-4ac3-85fd-59e97162be6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:45.627232 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863d6b-5c88-4ac3-85fd-59e97162be6f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:45.627516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863d6b-5c88-4ac3-85fd-59e97162be6f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:45.627781 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863d6b-5c88-4ac3-85fd-59e97162be6f None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:45.628515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61863d6b-5c88-4ac3-85fd-59e97162be6f None admin] RBAC: Adding query filter params (name=member) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:45.628810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61863d6b-5c88-4ac3-85fd-59e97162be6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:45.630173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61863d6b-5c88-4ac3-85fd-59e97162be6f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:45.639233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 145/290] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:45.644252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a52d0-6e16-477b-b331-0151e46e4510 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:45.757668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a52d0-6e16-477b-b331-0151e46e4510 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:45.790698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a387b5-293e-4a06-babb-1c100db8cb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:45.791591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a387b5-293e-4a06-babb-1c100db8cb63 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:45.791871 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a387b5-293e-4a06-babb-1c100db8cb63 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:45.792143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a387b5-293e-4a06-babb-1c100db8cb63 None admin] PATH_INFO: `/v3/users/6cafd0f9f2f34178aa343385780d84ce` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:45.793324 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a387b5-293e-4a06-babb-1c100db8cb63 None admin] RBAC: Authorizing `identity:get_user(user_id=6cafd0f9f2f34178aa343385780d84ce)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:45.794757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a387b5-293e-4a06-babb-1c100db8cb63 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:45.796677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 146/291] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:45 2022] GET /identity/v3/users/6cafd0f9f2f34178aa343385780d84ce => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:45.802256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61863d6b-5c88-4ac3-85fd-59e97162be6f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:45.973735 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61863d6b-5c88-4ac3-85fd-59e97162be6f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:46.020476 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614ac7-cc3a-4ec7-86c3-f9488dc9865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:46.021135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614ac7-cc3a-4ec7-86c3-f9488dc9865b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.021417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614ac7-cc3a-4ec7-86c3-f9488dc9865b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.021692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614ac7-cc3a-4ec7-86c3-f9488dc9865b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.120237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88614ac7-cc3a-4ec7-86c3-f9488dc9865b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:46.121695 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88614ac7-cc3a-4ec7-86c3-f9488dc9865b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:46.220416 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 146/292] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:46.226441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a387b5-293e-4a06-babb-1c100db8cb63 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:46.371644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a387b5-293e-4a06-babb-1c100db8cb63 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:46.414462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcb478-0334-4744-9c7e-67c55b9c1c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:46.416166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb478-0334-4744-9c7e-67c55b9c1c24 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.416650 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb478-0334-4744-9c7e-67c55b9c1c24 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.417122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb478-0334-4744-9c7e-67c55b9c1c24 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.418519 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcb478-0334-4744-9c7e-67c55b9c1c24 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:46.420285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcb478-0334-4744-9c7e-67c55b9c1c24 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:46.422503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 147/293] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:46 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:46.429271 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614ac7-cc3a-4ec7-86c3-f9488dc9865b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:46.564356 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1072-79b7-4284-a07f-6a8560927fd5 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.564967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1072-79b7-4284-a07f-6a8560927fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.565464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1072-79b7-4284-a07f-6a8560927fd5 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.567586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 148/294] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:24:46.573225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11141c-8384-4dd4-9609-b377a6505a3f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.573814 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11141c-8384-4dd4-9609-b377a6505a3f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.574289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11141c-8384-4dd4-9609-b377a6505a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.604855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6d11141c-8384-4dd4-9609-b377a6505a3f None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:46.606411 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6d11141c-8384-4dd4-9609-b377a6505a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:46.653491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614ac7-cc3a-4ec7-86c3-f9488dc9865b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:46.687719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 149/295] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:46.691362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279715a-c3ce-4b72-b0d6-f496e03257c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:46.692279 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279715a-c3ce-4b72-b0d6-f496e03257c3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.692753 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279715a-c3ce-4b72-b0d6-f496e03257c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.693220 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279715a-c3ce-4b72-b0d6-f496e03257c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.694248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279715a-c3ce-4b72-b0d6-f496e03257c3 None admin] RBAC: Adding query filter params (role.id=f8641f824b324fa2956c5fc5b764f8ae, scope.project.id=c02cb7cef6b84d34815a0826d3396e94, user.id=6cafd0f9f2f34178aa343385780d84ce) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:46.694756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279715a-c3ce-4b72-b0d6-f496e03257c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:46.696462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279715a-c3ce-4b72-b0d6-f496e03257c3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:46.707061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 147/296] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:46 2022] GET /identity/v3/role_assignments?user.id=6cafd0f9f2f34178aa343385780d84ce&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:46.710057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11141c-8384-4dd4-9609-b377a6505a3f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:46.815401 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11141c-8384-4dd4-9609-b377a6505a3f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:46.852132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd342d-7102-49c8-9e34-530b9fe02bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:46.853311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd342d-7102-49c8-9e34-530b9fe02bbf None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.853793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd342d-7102-49c8-9e34-530b9fe02bbf None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.854264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd342d-7102-49c8-9e34-530b9fe02bbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.866024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd342d-7102-49c8-9e34-530b9fe02bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:46.873572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-5ffd342d-7102-49c8-9e34-530b9fe02bbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:46.875198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 150/297] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:46.881850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279715a-c3ce-4b72-b0d6-f496e03257c3 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:46.979177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1047d-ae57-4240-91f9-acfab2995421 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.979859 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1047d-ae57-4240-91f9-acfab2995421 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.980336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1047d-ae57-4240-91f9-acfab2995421 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.982333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 151/298] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:46.988014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cf9e7-9345-4e7d-bfd2-ed93627f56a2 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.988554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cf9e7-9345-4e7d-bfd2-ed93627f56a2 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.989027 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cf9e7-9345-4e7d-bfd2-ed93627f56a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.014568 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-964cf9e7-9345-4e7d-bfd2-ed93627f56a2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:47.016182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-964cf9e7-9345-4e7d-bfd2-ed93627f56a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:47.054813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279715a-c3ce-4b72-b0d6-f496e03257c3 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:47.091842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b15f8c-41cb-4c79-89c0-41d4c6ce69f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:47.092093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 152/299] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:47.093217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b15f8c-41cb-4c79-89c0-41d4c6ce69f3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.093217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b15f8c-41cb-4c79-89c0-41d4c6ce69f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.093217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b15f8c-41cb-4c79-89c0-41d4c6ce69f3 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.098956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b15f8c-41cb-4c79-89c0-41d4c6ce69f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:47.098956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b15f8c-41cb-4c79-89c0-41d4c6ce69f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:47.098956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b15f8c-41cb-4c79-89c0-41d4c6ce69f3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:47.105443 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 148/300] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:47.110599 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cf9e7-9345-4e7d-bfd2-ed93627f56a2 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:47.119640 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b15f8c-41cb-4c79-89c0-41d4c6ce69f3 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:47.226284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cf9e7-9345-4e7d-bfd2-ed93627f56a2 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:47.228599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b15f8c-41cb-4c79-89c0-41d4c6ce69f3 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:47.260699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c777544-1832-46f4-b267-94bec441f476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:47.261719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425973f3-834e-4ad8-baa2-822772ad8a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:47.262134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c777544-1832-46f4-b267-94bec441f476 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.262520 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425973f3-834e-4ad8-baa2-822772ad8a17 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.262638 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c777544-1832-46f4-b267-94bec441f476 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.262790 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425973f3-834e-4ad8-baa2-822772ad8a17 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.263089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425973f3-834e-4ad8-baa2-822772ad8a17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.263181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c777544-1832-46f4-b267-94bec441f476 None admin] PATH_INFO: `/v3/users/c55fa2e18bf741d18e3400b1f2b4e84c` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.265113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c777544-1832-46f4-b267-94bec441f476 None admin] RBAC: Authorizing `identity:get_user(user_id=c55fa2e18bf741d18e3400b1f2b4e84c)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:47.268399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c777544-1832-46f4-b267-94bec441f476 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:47.275278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 153/301] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:47 2022] GET /identity/v3/users/c55fa2e18bf741d18e3400b1f2b4e84c => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:47.275278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e27b4-10a8-410f-a1f1-1fb593a25489 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.275278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e27b4-10a8-410f-a1f1-1fb593a25489 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.275278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e27b4-10a8-410f-a1f1-1fb593a25489 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.275278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 154/302] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:47.276063 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e27b4-10a8-410f-a1f1-1fb593a25489 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:47.281255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425973f3-834e-4ad8-baa2-822772ad8a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:47.288248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-425973f3-834e-4ad8-baa2-822772ad8a17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:24:47.294142 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 149/303] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:24:47.295442 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b19e68-9e3c-46ec-aafa-f80412477fef None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.295726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b19e68-9e3c-46ec-aafa-f80412477fef None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.296006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b19e68-9e3c-46ec-aafa-f80412477fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.315168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-56b19e68-9e3c-46ec-aafa-f80412477fef None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:47.316362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-56b19e68-9e3c-46ec-aafa-f80412477fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:47.375747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e27b4-10a8-410f-a1f1-1fb593a25489 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:47.382403 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 150/304] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:47.383274 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b19e68-9e3c-46ec-aafa-f80412477fef None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:47.413520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f833e7c-65f1-4c5d-a3ed-7ec0abb4f208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:47.414404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f833e7c-65f1-4c5d-a3ed-7ec0abb4f208 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.414686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f833e7c-65f1-4c5d-a3ed-7ec0abb4f208 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.415313 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f833e7c-65f1-4c5d-a3ed-7ec0abb4f208 None admin] PATH_INFO: `/v3/system/users/c55fa2e18bf741d18e3400b1f2b4e84c/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.416601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f833e7c-65f1-4c5d-a3ed-7ec0abb4f208 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c55fa2e18bf741d18e3400b1f2b4e84c, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:47.418002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f833e7c-65f1-4c5d-a3ed-7ec0abb4f208 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:47.439084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 155/305] 10.222.0.44 () {58 vars in 1334 bytes} [Mon Feb 28 10:24:47 2022] PUT /identity/v3/system/users/c55fa2e18bf741d18e3400b1f2b4e84c/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:24:47.439084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f833e7c-65f1-4c5d-a3ed-7ec0abb4f208 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:47.504141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b19e68-9e3c-46ec-aafa-f80412477fef None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:47.543894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017b3ef-803e-48f0-9ab0-9cc8c482b32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:47.544569 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017b3ef-803e-48f0-9ab0-9cc8c482b32a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.544841 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017b3ef-803e-48f0-9ab0-9cc8c482b32a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.545106 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017b3ef-803e-48f0-9ab0-9cc8c482b32a None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.545859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017b3ef-803e-48f0-9ab0-9cc8c482b32a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:47.546156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017b3ef-803e-48f0-9ab0-9cc8c482b32a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:47.547646 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017b3ef-803e-48f0-9ab0-9cc8c482b32a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:47.557010 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 151/306] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:47.562377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017b3ef-803e-48f0-9ab0-9cc8c482b32a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:47.573445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f833e7c-65f1-4c5d-a3ed-7ec0abb4f208 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:47.608796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa2779-bb36-4689-9640-4c2516eefa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:47.609504 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa2779-bb36-4689-9640-4c2516eefa62 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.609877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa2779-bb36-4689-9640-4c2516eefa62 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.611370 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa2779-bb36-4689-9640-4c2516eefa62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.611644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa2779-bb36-4689-9640-4c2516eefa62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:47.613119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa2779-bb36-4689-9640-4c2516eefa62 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:47.614717 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 156/307] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:47.621373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa2779-bb36-4689-9640-4c2516eefa62 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:47.690529 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017b3ef-803e-48f0-9ab0-9cc8c482b32a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:47.725909 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8bc46-1684-4e56-98af-acc256c8d294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:47.727610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8bc46-1684-4e56-98af-acc256c8d294 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.728407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8bc46-1684-4e56-98af-acc256c8d294 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.729034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8bc46-1684-4e56-98af-acc256c8d294 None admin] PATH_INFO: `/v3/users/0ba27dbf1ec6488aaca70faba9ee4cca` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.731276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa2779-bb36-4689-9640-4c2516eefa62 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:47.746469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8bc46-1684-4e56-98af-acc256c8d294 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba27dbf1ec6488aaca70faba9ee4cca)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:47.748728 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8bc46-1684-4e56-98af-acc256c8d294 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:47.751861 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 152/308] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:47 2022] GET /identity/v3/users/0ba27dbf1ec6488aaca70faba9ee4cca => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:47.758439 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8bc46-1684-4e56-98af-acc256c8d294 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:47.771512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4381d69-31e2-4620-bcd1-1861b17b0350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:47.772618 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381d69-31e2-4620-bcd1-1861b17b0350 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.773278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381d69-31e2-4620-bcd1-1861b17b0350 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.773764 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381d69-31e2-4620-bcd1-1861b17b0350 None admin] PATH_INFO: `/v3/groups` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.775161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4381d69-31e2-4620-bcd1-1861b17b0350 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:47.777105 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4381d69-31e2-4620-bcd1-1861b17b0350 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:47.796236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 157/309] 10.222.0.44 () {60 vars in 1134 bytes} [Mon Feb 28 10:24:47 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:24:47.803564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe317f-b7f2-470e-83a6-63fe3bef8343 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.803564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe317f-b7f2-470e-83a6-63fe3bef8343 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.803564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe317f-b7f2-470e-83a6-63fe3bef8343 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.803564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 158/310] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:47.807545 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b9ed-252e-423e-937d-e3a9c385d019 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.807941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b9ed-252e-423e-937d-e3a9c385d019 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.808108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b9ed-252e-423e-937d-e3a9c385d019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.826731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-1bd6b9ed-252e-423e-937d-e3a9c385d019 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:47.827954 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-1bd6b9ed-252e-423e-937d-e3a9c385d019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:47.880660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8bc46-1684-4e56-98af-acc256c8d294 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:47.920862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599048f-3c66-4fa5-886f-e18d2babf289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:47.921894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599048f-3c66-4fa5-886f-e18d2babf289 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.922400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599048f-3c66-4fa5-886f-e18d2babf289 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.922953 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599048f-3c66-4fa5-886f-e18d2babf289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.924123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599048f-3c66-4fa5-886f-e18d2babf289 None admin] RBAC: Adding query filter params (role.id=1b0597a6df10450bb5b56ed2c8b6261d, user.id=0ba27dbf1ec6488aaca70faba9ee4cca, scope.system=all) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:47.924642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599048f-3c66-4fa5-886f-e18d2babf289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:47.926467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599048f-3c66-4fa5-886f-e18d2babf289 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:47.932885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 153/311] 10.222.0.44 () {56 vars in 1308 bytes} [Mon Feb 28 10:24:47 2022] GET /identity/v3/role_assignments?user.id=0ba27dbf1ec6488aaca70faba9ee4cca&scope.system=all&role.id=1b0597a6df10450bb5b56ed2c8b6261d => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:48.036082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 159/312] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:48.060798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599048f-3c66-4fa5-886f-e18d2babf289 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:48.174451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599048f-3c66-4fa5-886f-e18d2babf289 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:48.208263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77684529-dd57-4329-8350-8c42806f3fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:48.209313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684529-dd57-4329-8350-8c42806f3fd2 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:48.209729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684529-dd57-4329-8350-8c42806f3fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:48.210135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684529-dd57-4329-8350-8c42806f3fd2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:48.220356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77684529-dd57-4329-8350-8c42806f3fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:48.227392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-77684529-dd57-4329-8350-8c42806f3fd2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:24:48.233179 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 154/313] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:48.235265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6b9ed-252e-423e-937d-e3a9c385d019 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:48.336156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6b9ed-252e-423e-937d-e3a9c385d019 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:48.369504 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1c969-2325-4ce1-b406-f4bb124a1f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:48.370177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1c969-2325-4ce1-b406-f4bb124a1f2f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:48.370457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1c969-2325-4ce1-b406-f4bb124a1f2f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:48.370729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1c969-2325-4ce1-b406-f4bb124a1f2f None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:48.371508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1c969-2325-4ce1-b406-f4bb124a1f2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:48.371808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1c969-2325-4ce1-b406-f4bb124a1f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:48.373167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1c969-2325-4ce1-b406-f4bb124a1f2f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:48.382112 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 160/314] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:48.387995 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77684529-dd57-4329-8350-8c42806f3fd2 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:48.486571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77684529-dd57-4329-8350-8c42806f3fd2 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:48.523685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb32f8-1c94-4a28-b804-db66fa943409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:48.524606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb32f8-1c94-4a28-b804-db66fa943409 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:48.524889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb32f8-1c94-4a28-b804-db66fa943409 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:48.525157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb32f8-1c94-4a28-b804-db66fa943409 None admin] PATH_INFO: `/v3/users/d14ae1e0c0074c808735654b73d34176` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:48.526331 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb32f8-1c94-4a28-b804-db66fa943409 None admin] RBAC: Authorizing `identity:get_user(user_id=d14ae1e0c0074c808735654b73d34176)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:48.527846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb32f8-1c94-4a28-b804-db66fa943409 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:48.529821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 155/315] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:48 2022] GET /identity/v3/users/d14ae1e0c0074c808735654b73d34176 => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:48.535349 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1c969-2325-4ce1-b406-f4bb124a1f2f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:48.639549 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1c969-2325-4ce1-b406-f4bb124a1f2f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:48.674712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401965f2-6c51-438d-87f0-4826724f30a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:48.675398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401965f2-6c51-438d-87f0-4826724f30a8 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:48.675680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401965f2-6c51-438d-87f0-4826724f30a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:48.675954 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401965f2-6c51-438d-87f0-4826724f30a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:48.746104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401965f2-6c51-438d-87f0-4826724f30a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:48.747626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401965f2-6c51-438d-87f0-4826724f30a8 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:48.847452 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 161/316] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:48.855957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb32f8-1c94-4a28-b804-db66fa943409 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:48.955221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb32f8-1c94-4a28-b804-db66fa943409 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:48.989019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051276c2-2045-4068-8545-3e36b1045267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:48.989881 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051276c2-2045-4068-8545-3e36b1045267 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:48.990158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051276c2-2045-4068-8545-3e36b1045267 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:48.990428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051276c2-2045-4068-8545-3e36b1045267 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:48.991642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051276c2-2045-4068-8545-3e36b1045267 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:48.993078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051276c2-2045-4068-8545-3e36b1045267 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:48.995015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 156/317] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:48 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:49.000636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401965f2-6c51-438d-87f0-4826724f30a8 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:49.102422 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401965f2-6c51-438d-87f0-4826724f30a8 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:49.137419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4970ad-0f3c-4045-934d-588b830b6845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:49.138087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4970ad-0f3c-4045-934d-588b830b6845 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:49.138368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4970ad-0f3c-4045-934d-588b830b6845 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:49.138637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4970ad-0f3c-4045-934d-588b830b6845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:49.139506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4970ad-0f3c-4045-934d-588b830b6845 None admin] RBAC: Adding query filter params (role.id=1b0597a6df10450bb5b56ed2c8b6261d, scope.project.id=c02cb7cef6b84d34815a0826d3396e94, user.id=d14ae1e0c0074c808735654b73d34176) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:49.139819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4970ad-0f3c-4045-934d-588b830b6845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:49.141276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4970ad-0f3c-4045-934d-588b830b6845 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:49.148817 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 162/318] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:24:48 2022] GET /identity/v3/role_assignments?user.id=d14ae1e0c0074c808735654b73d34176&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=1b0597a6df10450bb5b56ed2c8b6261d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:49.769483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbfc0c-6436-48c9-83aa-5df013c5759b None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:49.769848 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbfc0c-6436-48c9-83aa-5df013c5759b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:49.770025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbfc0c-6436-48c9-83aa-5df013c5759b None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:49.771850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 157/319] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:49.777044 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865c422-6836-431e-907a-cc188c3548ec None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:49.777506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865c422-6836-431e-907a-cc188c3548ec None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:49.777597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865c422-6836-431e-907a-cc188c3548ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:49.793968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-3865c422-6836-431e-907a-cc188c3548ec None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:49.795181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3865c422-6836-431e-907a-cc188c3548ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:49.858784 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 163/320] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:49.882061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbfc0c-6436-48c9-83aa-5df013c5759b None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:49.988909 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbfc0c-6436-48c9-83aa-5df013c5759b None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:50.021127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13c18c-31c9-47b0-b7e6-d80007475fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:50.021839 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13c18c-31c9-47b0-b7e6-d80007475fe9 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.022113 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13c18c-31c9-47b0-b7e6-d80007475fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.022382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13c18c-31c9-47b0-b7e6-d80007475fe9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.032175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13c18c-31c9-47b0-b7e6-d80007475fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:50.038971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-9e13c18c-31c9-47b0-b7e6-d80007475fe9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:50.040355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 158/321] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:50.045930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865c422-6836-431e-907a-cc188c3548ec None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:50.147177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865c422-6836-431e-907a-cc188c3548ec None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:50.179497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a50c5a-6e70-43f6-8d74-73f8edda8b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:50.180161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a50c5a-6e70-43f6-8d74-73f8edda8b50 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.180442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a50c5a-6e70-43f6-8d74-73f8edda8b50 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.180715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a50c5a-6e70-43f6-8d74-73f8edda8b50 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.181450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a50c5a-6e70-43f6-8d74-73f8edda8b50 None admin] RBAC: Adding query filter params (name=member) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:50.181750 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a50c5a-6e70-43f6-8d74-73f8edda8b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:50.183125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a50c5a-6e70-43f6-8d74-73f8edda8b50 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:50.191751 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 164/322] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:50.197007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13c18c-31c9-47b0-b7e6-d80007475fe9 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:50.292256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13c18c-31c9-47b0-b7e6-d80007475fe9 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:50.303280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe79d62-356d-454d-9894-4f79ea00057b None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.303564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe79d62-356d-454d-9894-4f79ea00057b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.303833 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe79d62-356d-454d-9894-4f79ea00057b None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.305713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 165/323] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:24:50.310310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e84a-066e-4aae-822e-7ab0f68f3557 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.310593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e84a-066e-4aae-822e-7ab0f68f3557 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.310871 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e84a-066e-4aae-822e-7ab0f68f3557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.324836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3794fa-9084-4446-abdb-82803fdbc1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:50.325690 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3794fa-9084-4446-abdb-82803fdbc1f9 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.325964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3794fa-9084-4446-abdb-82803fdbc1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.326234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3794fa-9084-4446-abdb-82803fdbc1f9 None admin] PATH_INFO: `/v3/users/c55fa2e18bf741d18e3400b1f2b4e84c` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.327429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3794fa-9084-4446-abdb-82803fdbc1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c55fa2e18bf741d18e3400b1f2b4e84c)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:50.328291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-64a7e84a-066e-4aae-822e-7ab0f68f3557 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:50.328888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3794fa-9084-4446-abdb-82803fdbc1f9 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:50.330014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-64a7e84a-066e-4aae-822e-7ab0f68f3557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:50.331366 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 159/324] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:50 2022] GET /identity/v3/users/c55fa2e18bf741d18e3400b1f2b4e84c => generated 293 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:50.332365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb5706-8aa2-499b-a48b-a61715bbe41d None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.332649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb5706-8aa2-499b-a48b-a61715bbe41d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.332917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb5706-8aa2-499b-a48b-a61715bbe41d None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.334537 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 160/325] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:50.336710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb5706-8aa2-499b-a48b-a61715bbe41d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:50.393915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 166/326] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:50.396290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b6e53-17f6-4921-90b8-700fa2ae1b63 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.396860 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b6e53-17f6-4921-90b8-700fa2ae1b63 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.397147 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b6e53-17f6-4921-90b8-700fa2ae1b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.412760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-445b6e53-17f6-4921-90b8-700fa2ae1b63 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:50.413931 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-445b6e53-17f6-4921-90b8-700fa2ae1b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:50.433285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb5706-8aa2-499b-a48b-a61715bbe41d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:50.474208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea497214-5d3c-4426-ab84-48ac69ec995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:50.475340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea497214-5d3c-4426-ab84-48ac69ec995a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.475821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea497214-5d3c-4426-ab84-48ac69ec995a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.476279 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea497214-5d3c-4426-ab84-48ac69ec995a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.477248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea497214-5d3c-4426-ab84-48ac69ec995a None admin] RBAC: Adding query filter params (role.id=f8641f824b324fa2956c5fc5b764f8ae, user.id=c55fa2e18bf741d18e3400b1f2b4e84c, scope.system=all) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:50.477393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 167/327] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:50.477558 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea497214-5d3c-4426-ab84-48ac69ec995a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:50.478116 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b6e53-17f6-4921-90b8-700fa2ae1b63 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:50.479145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea497214-5d3c-4426-ab84-48ac69ec995a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:50.502948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 161/328] 10.222.0.44 () {56 vars in 1308 bytes} [Mon Feb 28 10:24:50 2022] GET /identity/v3/role_assignments?user.id=c55fa2e18bf741d18e3400b1f2b4e84c&scope.system=all&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 510 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:50.502948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea497214-5d3c-4426-ab84-48ac69ec995a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:50.587463 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b6e53-17f6-4921-90b8-700fa2ae1b63 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:50.606734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea497214-5d3c-4426-ab84-48ac69ec995a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:50.623030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf872d-94d3-43a4-a21f-9c55f247c71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:50.623825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf872d-94d3-43a4-a21f-9c55f247c71a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.624101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf872d-94d3-43a4-a21f-9c55f247c71a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.624364 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf872d-94d3-43a4-a21f-9c55f247c71a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.625568 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf872d-94d3-43a4-a21f-9c55f247c71a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:50.627603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf872d-94d3-43a4-a21f-9c55f247c71a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:50.629487 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 168/329] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:24:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:50.635025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf872d-94d3-43a4-a21f-9c55f247c71a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:50.642719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f8124-2703-48cf-aa7b-35c859f1519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:50.643572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f8124-2703-48cf-aa7b-35c859f1519f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.643856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f8124-2703-48cf-aa7b-35c859f1519f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.644121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f8124-2703-48cf-aa7b-35c859f1519f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.654806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f8124-2703-48cf-aa7b-35c859f1519f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:50.661986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-9a9f8124-2703-48cf-aa7b-35c859f1519f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:24:50.663262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 162/330] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:24:50.669430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f8124-2703-48cf-aa7b-35c859f1519f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:50.741603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf872d-94d3-43a4-a21f-9c55f247c71a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:50.773259 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f8124-2703-48cf-aa7b-35c859f1519f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:50.775300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcbb7d-f01e-4dbc-9f80-a5a88471368f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:50.775958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbb7d-f01e-4dbc-9f80-a5a88471368f None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.776237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbb7d-f01e-4dbc-9f80-a5a88471368f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.776504 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbb7d-f01e-4dbc-9f80-a5a88471368f None admin] PATH_INFO: `/v3/groups` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.777209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcbb7d-f01e-4dbc-9f80-a5a88471368f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:50.778621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcbb7d-f01e-4dbc-9f80-a5a88471368f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:50.793185 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 169/331] 10.222.0.44 () {60 vars in 1134 bytes} [Mon Feb 28 10:24:50 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:24:50.806854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd21637-7746-4f06-b396-4528248eb4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:50.807578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21637-7746-4f06-b396-4528248eb4f4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.807858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21637-7746-4f06-b396-4528248eb4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.808128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21637-7746-4f06-b396-4528248eb4f4 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.808888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd21637-7746-4f06-b396-4528248eb4f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:50.809190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd21637-7746-4f06-b396-4528248eb4f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:50.810674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd21637-7746-4f06-b396-4528248eb4f4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:50.820045 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 163/332] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:50.825861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcbb7d-f01e-4dbc-9f80-a5a88471368f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:50.927691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcbb7d-f01e-4dbc-9f80-a5a88471368f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:50.962057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd9e07-0cd0-4142-98a8-256b370a7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:50.962954 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd9e07-0cd0-4142-98a8-256b370a7916 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:50.963300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd9e07-0cd0-4142-98a8-256b370a7916 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:50.963932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd9e07-0cd0-4142-98a8-256b370a7916 None admin] PATH_INFO: `/v3/users/0ba27dbf1ec6488aaca70faba9ee4cca` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:50.965193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd9e07-0cd0-4142-98a8-256b370a7916 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba27dbf1ec6488aaca70faba9ee4cca)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:50.966629 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd9e07-0cd0-4142-98a8-256b370a7916 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:50.968270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 170/333] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:50 2022] GET /identity/v3/users/0ba27dbf1ec6488aaca70faba9ee4cca => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:50.974621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd21637-7746-4f06-b396-4528248eb4f4 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:51.075032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd21637-7746-4f06-b396-4528248eb4f4 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:51.110718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157a4c1-c3e7-42ad-9f22-7272aaec5708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:51.111628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157a4c1-c3e7-42ad-9f22-7272aaec5708 None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:51.111898 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157a4c1-c3e7-42ad-9f22-7272aaec5708 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:51.112165 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157a4c1-c3e7-42ad-9f22-7272aaec5708 None admin] PATH_INFO: `/v3/system/users/0ba27dbf1ec6488aaca70faba9ee4cca/roles/1b0597a6df10450bb5b56ed2c8b6261d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:51.113634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157a4c1-c3e7-42ad-9f22-7272aaec5708 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0ba27dbf1ec6488aaca70faba9ee4cca, role_id=1b0597a6df10450bb5b56ed2c8b6261d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:51.115027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157a4c1-c3e7-42ad-9f22-7272aaec5708 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:51.123946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 164/334] 10.222.0.44 () {58 vars in 1334 bytes} [Mon Feb 28 10:24:50 2022] PUT /identity/v3/system/users/0ba27dbf1ec6488aaca70faba9ee4cca/roles/1b0597a6df10450bb5b56ed2c8b6261d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:24:53.848203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c5e73-1d0a-4657-8005-8aa233849993 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:53.849215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c5e73-1d0a-4657-8005-8aa233849993 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:53.849710 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c5e73-1d0a-4657-8005-8aa233849993 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:53.851719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 171/335] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:53.857204 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb03630-f37a-4f32-a3a0-554ba994f439 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:53.858078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb03630-f37a-4f32-a3a0-554ba994f439 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:53.858564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb03630-f37a-4f32-a3a0-554ba994f439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:53.881036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0cb03630-f37a-4f32-a3a0-554ba994f439 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:53.882565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0cb03630-f37a-4f32-a3a0-554ba994f439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:53.959905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 165/336] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:54.016758 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c5e73-1d0a-4657-8005-8aa233849993 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:54.054946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9838227-9c1b-4807-98ec-fe8dc7632c04 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.055199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9838227-9c1b-4807-98ec-fe8dc7632c04 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.055608 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9838227-9c1b-4807-98ec-fe8dc7632c04 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.057831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 166/337] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:54.064018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5a7b9-0804-472f-ac84-28be75f7db11 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.064561 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5a7b9-0804-472f-ac84-28be75f7db11 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.065037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5a7b9-0804-472f-ac84-28be75f7db11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.087943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-85e5a7b9-0804-472f-ac84-28be75f7db11 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:54.089169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-85e5a7b9-0804-472f-ac84-28be75f7db11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:54.144412 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c5e73-1d0a-4657-8005-8aa233849993 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:54.184135 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bd76a-fd08-416e-b77e-efa64fc1492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:54.185296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bd76a-fd08-416e-b77e-efa64fc1492f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.185788 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bd76a-fd08-416e-b77e-efa64fc1492f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.186258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bd76a-fd08-416e-b77e-efa64fc1492f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.199273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bd76a-fd08-416e-b77e-efa64fc1492f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:54.207941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-cb1bd76a-fd08-416e-b77e-efa64fc1492f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:54.209913 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 172/338] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:54.211504 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f63d5-2188-40af-ba17-48e735e1d4a4 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.212006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f63d5-2188-40af-ba17-48e735e1d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.212471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f63d5-2188-40af-ba17-48e735e1d4a4 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.214549 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 173/339] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:54.216759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f63d5-2188-40af-ba17-48e735e1d4a4 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:54.261739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 167/340] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:24:54.263102 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a6e97-0f0d-4325-9a4b-858722a131bc None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.263391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a6e97-0f0d-4325-9a4b-858722a131bc None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.263664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a6e97-0f0d-4325-9a4b-858722a131bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.296305 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-b04a6e97-0f0d-4325-9a4b-858722a131bc None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:54.298026 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b04a6e97-0f0d-4325-9a4b-858722a131bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:54.346724 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f63d5-2188-40af-ba17-48e735e1d4a4 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:54.373638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 168/341] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:54.373638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbcbaa-5622-49da-bd67-9ad06eb84446 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.373638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbcbaa-5622-49da-bd67-9ad06eb84446 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.373638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbcbaa-5622-49da-bd67-9ad06eb84446 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.374025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 169/342] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:54.376986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbcbaa-5622-49da-bd67-9ad06eb84446 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:54.396695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccb97b-869c-41b7-b6ab-1f458c75be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:54.397294 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccb97b-869c-41b7-b6ab-1f458c75be3f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.397579 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccb97b-869c-41b7-b6ab-1f458c75be3f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.397860 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccb97b-869c-41b7-b6ab-1f458c75be3f None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.398614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccb97b-869c-41b7-b6ab-1f458c75be3f None admin] RBAC: Adding query filter params (name=member) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:54.398946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccb97b-869c-41b7-b6ab-1f458c75be3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:54.400373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccb97b-869c-41b7-b6ab-1f458c75be3f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:54.410298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 174/343] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:54.411606 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab090c-edb9-40cb-af21-646b29e5e8fb None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.412246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab090c-edb9-40cb-af21-646b29e5e8fb None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.412723 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab090c-edb9-40cb-af21-646b29e5e8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.430745 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-81ab090c-edb9-40cb-af21-646b29e5e8fb None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:54.432868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-81ab090c-edb9-40cb-af21-646b29e5e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:54.487834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbcbaa-5622-49da-bd67-9ad06eb84446 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:54.505038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 175/344] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:54.506343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab090c-edb9-40cb-af21-646b29e5e8fb None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:54.524640 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2617e8-0061-49eb-9ff2-285ae36b0884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:54.525493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2617e8-0061-49eb-9ff2-285ae36b0884 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.525764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2617e8-0061-49eb-9ff2-285ae36b0884 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.526027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2617e8-0061-49eb-9ff2-285ae36b0884 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.537338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2617e8-0061-49eb-9ff2-285ae36b0884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:54.544767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-9a2617e8-0061-49eb-9ff2-285ae36b0884 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:24:54.546025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 170/345] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:24:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:54.546803 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2617e8-0061-49eb-9ff2-285ae36b0884 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:54.608359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab090c-edb9-40cb-af21-646b29e5e8fb None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:54.645427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5feb9d-3cac-40de-9056-5cc5b587422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:54.646442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5feb9d-3cac-40de-9056-5cc5b587422c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.647011 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5feb9d-3cac-40de-9056-5cc5b587422c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.647523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5feb9d-3cac-40de-9056-5cc5b587422c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.651676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2617e8-0061-49eb-9ff2-285ae36b0884 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:54.686461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca6c54-c127-4cd8-a8eb-fd7f7d94f0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:54.687320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6c54-c127-4cd8-a8eb-fd7f7d94f0ac None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.687595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6c54-c127-4cd8-a8eb-fd7f7d94f0ac None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.688241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6c54-c127-4cd8-a8eb-fd7f7d94f0ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.699504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca6c54-c127-4cd8-a8eb-fd7f7d94f0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:54.707078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-01ca6c54-c127-4cd8-a8eb-fd7f7d94f0ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:24:54.708612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 171/346] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:54.709461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca6c54-c127-4cd8-a8eb-fd7f7d94f0ac None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:54.718138 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5feb9d-3cac-40de-9056-5cc5b587422c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:54.721038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5feb9d-3cac-40de-9056-5cc5b587422c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:54.809329 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca6c54-c127-4cd8-a8eb-fd7f7d94f0ac None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:54.822854 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 176/347] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:54.824198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5feb9d-3cac-40de-9056-5cc5b587422c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:54.847829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e7628-e8f6-4b2c-8952-a1ca15c662dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:54.848632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e7628-e8f6-4b2c-8952-a1ca15c662dc None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.848891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e7628-e8f6-4b2c-8952-a1ca15c662dc None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.849160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e7628-e8f6-4b2c-8952-a1ca15c662dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.860029 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e7628-e8f6-4b2c-8952-a1ca15c662dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:54.867414 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-ee2e7628-e8f6-4b2c-8952-a1ca15c662dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:54.868624 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 172/348] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:54.869590 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e7628-e8f6-4b2c-8952-a1ca15c662dc None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:54.926843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5feb9d-3cac-40de-9056-5cc5b587422c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:54.963193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b34da6-c75b-41a7-a8ef-463607059556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:54.964247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b34da6-c75b-41a7-a8ef-463607059556 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:54.964758 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b34da6-c75b-41a7-a8ef-463607059556 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:54.965244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b34da6-c75b-41a7-a8ef-463607059556 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:54.966194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b34da6-c75b-41a7-a8ef-463607059556 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:54.966709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b34da6-c75b-41a7-a8ef-463607059556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:54.968497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b34da6-c75b-41a7-a8ef-463607059556 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:54.971722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e7628-e8f6-4b2c-8952-a1ca15c662dc None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:54.977940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 177/349] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:24:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:54.979205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b34da6-c75b-41a7-a8ef-463607059556 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:55.005975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0735e04-01b3-447d-808a-b48f414c162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:55.006640 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735e04-01b3-447d-808a-b48f414c162c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:55.006934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735e04-01b3-447d-808a-b48f414c162c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:55.007208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735e04-01b3-447d-808a-b48f414c162c None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:55.008042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0735e04-01b3-447d-808a-b48f414c162c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:55.008343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0735e04-01b3-447d-808a-b48f414c162c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:55.009709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0735e04-01b3-447d-808a-b48f414c162c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:55.019047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 173/350] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:55.019870 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0735e04-01b3-447d-808a-b48f414c162c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:55.088184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b34da6-c75b-41a7-a8ef-463607059556 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:55.123583 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0735e04-01b3-447d-808a-b48f414c162c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:55.125400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa80a9-4857-4f71-87a3-879983896cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:55.126797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa80a9-4857-4f71-87a3-879983896cef None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:55.127108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa80a9-4857-4f71-87a3-879983896cef None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:55.127382 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa80a9-4857-4f71-87a3-879983896cef None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:55.128590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa80a9-4857-4f71-87a3-879983896cef None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:55.130019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa80a9-4857-4f71-87a3-879983896cef None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:55.131733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 178/351] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:54 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:55.132575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa80a9-4857-4f71-87a3-879983896cef None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:55.164586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191ebb4-9775-4b09-b99d-37d299e732ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:55.165569 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ebb4-9775-4b09-b99d-37d299e732ca None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:55.165844 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ebb4-9775-4b09-b99d-37d299e732ca None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:55.166156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ebb4-9775-4b09-b99d-37d299e732ca None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:55.167080 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191ebb4-9775-4b09-b99d-37d299e732ca None admin] RBAC: Adding query filter params (name=member) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:55.167390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191ebb4-9775-4b09-b99d-37d299e732ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:55.169904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191ebb4-9775-4b09-b99d-37d299e732ca None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:55.181514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 174/352] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:55.182416 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191ebb4-9775-4b09-b99d-37d299e732ca None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:55.243795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa80a9-4857-4f71-87a3-879983896cef None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:55.291938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fc270-d7ec-4822-87b9-987f432ae407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:55.292861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fc270-d7ec-4822-87b9-987f432ae407 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:55.293454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fc270-d7ec-4822-87b9-987f432ae407 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:55.294648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fc270-d7ec-4822-87b9-987f432ae407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:55.314784 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191ebb4-9775-4b09-b99d-37d299e732ca None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:55.353326 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a8615-9e40-4469-b109-82864f6aa4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:55.354581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a8615-9e40-4469-b109-82864f6aa4f1 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:55.355127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a8615-9e40-4469-b109-82864f6aa4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:55.355603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a8615-9e40-4469-b109-82864f6aa4f1 None admin] PATH_INFO: `/v3/users/0ba27dbf1ec6488aaca70faba9ee4cca` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:55.357111 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a8615-9e40-4469-b109-82864f6aa4f1 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba27dbf1ec6488aaca70faba9ee4cca)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:55.358770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a8615-9e40-4469-b109-82864f6aa4f1 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:55.363485 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 175/353] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:24:55 2022] GET /identity/v3/users/0ba27dbf1ec6488aaca70faba9ee4cca => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:55.364589 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a8615-9e40-4469-b109-82864f6aa4f1 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:55.379645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fc270-d7ec-4822-87b9-987f432ae407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:55.379645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fc270-d7ec-4822-87b9-987f432ae407 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:55.493738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a8615-9e40-4469-b109-82864f6aa4f1 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:55.498665 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 179/354] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:55.503546 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fc270-d7ec-4822-87b9-987f432ae407 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:55.533744 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d28de2-0b95-48b5-b782-fa2abb30a4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:55.534597 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28de2-0b95-48b5-b782-fa2abb30a4f7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:55.534931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28de2-0b95-48b5-b782-fa2abb30a4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:55.535215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28de2-0b95-48b5-b782-fa2abb30a4f7 None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:55.542600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d28de2-0b95-48b5-b782-fa2abb30a4f7 None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:55.544082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d28de2-0b95-48b5-b782-fa2abb30a4f7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:55.545985 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 176/355] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:24:55 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:55.546534 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d28de2-0b95-48b5-b782-fa2abb30a4f7 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:55.623774 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fc270-d7ec-4822-87b9-987f432ae407 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:55.669411 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0225598-65e5-47ce-9f77-1e0ba534c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:55.670435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0225598-65e5-47ce-9f77-1e0ba534c8ef None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:55.670795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d28de2-0b95-48b5-b782-fa2abb30a4f7 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:55.671010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0225598-65e5-47ce-9f77-1e0ba534c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:55.671288 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0225598-65e5-47ce-9f77-1e0ba534c8ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:55.708356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0116d6-1c24-4b4e-805d-e2b2899a20da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:55.709017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0116d6-1c24-4b4e-805d-e2b2899a20da None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:55.709298 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0116d6-1c24-4b4e-805d-e2b2899a20da None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:55.709572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0116d6-1c24-4b4e-805d-e2b2899a20da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:55.710547 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0116d6-1c24-4b4e-805d-e2b2899a20da None admin] RBAC: Adding query filter params (role.id=1b0597a6df10450bb5b56ed2c8b6261d, user.id=0ba27dbf1ec6488aaca70faba9ee4cca, scope.system=all) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:55.710698 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0116d6-1c24-4b4e-805d-e2b2899a20da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:55.712165 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0116d6-1c24-4b4e-805d-e2b2899a20da None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:55.731514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 177/356] 10.222.0.44 () {56 vars in 1308 bytes} [Mon Feb 28 10:24:55 2022] GET /identity/v3/role_assignments?user.id=0ba27dbf1ec6488aaca70faba9ee4cca&scope.system=all&role.id=1b0597a6df10450bb5b56ed2c8b6261d => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:55.734176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9516c7-09ca-4c6e-afab-d8347cbf4ccd None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:55.735282 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9516c7-09ca-4c6e-afab-d8347cbf4ccd None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:55.736304 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9516c7-09ca-4c6e-afab-d8347cbf4ccd None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:55.738816 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 178/357] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:55.743936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9516c7-09ca-4c6e-afab-d8347cbf4ccd None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:55.769834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0225598-65e5-47ce-9f77-1e0ba534c8ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:55.771372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0225598-65e5-47ce-9f77-1e0ba534c8ef None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:55.870803 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9516c7-09ca-4c6e-afab-d8347cbf4ccd None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:55.881664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 180/358] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:55.882682 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0225598-65e5-47ce-9f77-1e0ba534c8ef None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:55.917055 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4cf71-40b0-4d1a-a85a-1eff377bd4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:55.918335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4cf71-40b0-4d1a-a85a-1eff377bd4aa None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:55.918614 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4cf71-40b0-4d1a-a85a-1eff377bd4aa None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:55.918886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4cf71-40b0-4d1a-a85a-1eff377bd4aa None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:55.920208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4cf71-40b0-4d1a-a85a-1eff377bd4aa None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:55.921700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4cf71-40b0-4d1a-a85a-1eff377bd4aa None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:55.928610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 179/359] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:55 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:55.928610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5d0b6-8652-4cf3-8f7b-a68f1f57c0e7 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:55.928610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5d0b6-8652-4cf3-8f7b-a68f1f57c0e7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:55.928610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5d0b6-8652-4cf3-8f7b-a68f1f57c0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:55.947496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-68a5d0b6-8652-4cf3-8f7b-a68f1f57c0e7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:55.948691 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-68a5d0b6-8652-4cf3-8f7b-a68f1f57c0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:55.989766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0225598-65e5-47ce-9f77-1e0ba534c8ef None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:56.024739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261420e7-4605-4b29-82ab-5711b77dbc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:56.025273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261420e7-4605-4b29-82ab-5711b77dbc28 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:56.025555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261420e7-4605-4b29-82ab-5711b77dbc28 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:56.025829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261420e7-4605-4b29-82ab-5711b77dbc28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:56.026645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261420e7-4605-4b29-82ab-5711b77dbc28 None admin] RBAC: Adding query filter params (group.id=fb48d522c45744b3beb13f7907b84aba, role.id=f8641f824b324fa2956c5fc5b764f8ae, scope.project.id=c02cb7cef6b84d34815a0826d3396e94) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:56.026988 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261420e7-4605-4b29-82ab-5711b77dbc28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:56.028403 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261420e7-4605-4b29-82ab-5711b77dbc28 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:56.031451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 180/360] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:56.032828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a606a7d-6f87-4be1-a4a6-9b4f3c75093d None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:56.033112 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a606a7d-6f87-4be1-a4a6-9b4f3c75093d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:56.034066 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a606a7d-6f87-4be1-a4a6-9b4f3c75093d None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:56.035996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 181/361] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:56.036291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 181/362] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Feb 28 10:24:55 2022] GET /identity/v3/role_assignments?group.id=fb48d522c45744b3beb13f7907b84aba&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:56.036627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a606a7d-6f87-4be1-a4a6-9b4f3c75093d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:56.037530 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261420e7-4605-4b29-82ab-5711b77dbc28 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:56.168615 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261420e7-4605-4b29-82ab-5711b77dbc28 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:56.201478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a606a7d-6f87-4be1-a4a6-9b4f3c75093d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:56.222619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428361df-1d06-4e00-9d31-2f1511b3d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:56.223912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428361df-1d06-4e00-9d31-2f1511b3d077 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:56.224388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428361df-1d06-4e00-9d31-2f1511b3d077 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:56.224836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428361df-1d06-4e00-9d31-2f1511b3d077 None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:56.226259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428361df-1d06-4e00-9d31-2f1511b3d077 None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:56.227774 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428361df-1d06-4e00-9d31-2f1511b3d077 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:56.229686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 182/363] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:24:56 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:56.230870 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4bd72-c149-4687-92a8-61b4f0f07498 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:56.231192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4bd72-c149-4687-92a8-61b4f0f07498 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:56.231495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4bd72-c149-4687-92a8-61b4f0f07498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:56.242082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175fa2-bf90-4e39-a0c1-fb9592da22ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:56.243400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175fa2-bf90-4e39-a0c1-fb9592da22ef None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:56.243519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175fa2-bf90-4e39-a0c1-fb9592da22ef None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:56.243699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175fa2-bf90-4e39-a0c1-fb9592da22ef None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:56.245491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd175fa2-bf90-4e39-a0c1-fb9592da22ef None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:56.248914 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd175fa2-bf90-4e39-a0c1-fb9592da22ef None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:56.248914 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 182/364] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:56 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:56.249389 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175fa2-bf90-4e39-a0c1-fb9592da22ef None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:56.256903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-61c4bd72-c149-4687-92a8-61b4f0f07498 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:56.258115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-61c4bd72-c149-4687-92a8-61b4f0f07498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:56.352968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 183/365] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:56.353832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4bd72-c149-4687-92a8-61b4f0f07498 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:56.376483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175fa2-bf90-4e39-a0c1-fb9592da22ef None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:56.417884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed269f5-55f6-476f-a0bb-1926041b8366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:56.418700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed269f5-55f6-476f-a0bb-1926041b8366 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:56.419011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed269f5-55f6-476f-a0bb-1926041b8366 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:56.419285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed269f5-55f6-476f-a0bb-1926041b8366 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:56.435263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed269f5-55f6-476f-a0bb-1926041b8366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:56.445254 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-5ed269f5-55f6-476f-a0bb-1926041b8366 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:24:56.450924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 183/366] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:24:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:56.450924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed269f5-55f6-476f-a0bb-1926041b8366 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:56.482734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4bd72-c149-4687-92a8-61b4f0f07498 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:56.525982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b5751-3d28-43a7-ac72-5e1d2a2a2ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:56.526640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b5751-3d28-43a7-ac72-5e1d2a2a2ecc None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:56.526999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b5751-3d28-43a7-ac72-5e1d2a2a2ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:56.527279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b5751-3d28-43a7-ac72-5e1d2a2a2ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:56.528103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b5751-3d28-43a7-ac72-5e1d2a2a2ecc None admin] RBAC: Adding query filter params (group.id=fb48d522c45744b3beb13f7907b84aba, role.id=79396755fc0842a882775515d6feab13, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:56.528413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b5751-3d28-43a7-ac72-5e1d2a2a2ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:56.529825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b5751-3d28-43a7-ac72-5e1d2a2a2ecc None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:56.535596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 184/367] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Feb 28 10:24:56 2022] GET /identity/v3/role_assignments?group.id=fb48d522c45744b3beb13f7907b84aba&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=79396755fc0842a882775515d6feab13 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:56.536392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b5751-3d28-43a7-ac72-5e1d2a2a2ecc None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:56.587876 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed269f5-55f6-476f-a0bb-1926041b8366 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:56.627145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545dd2-bda4-4d1e-a532-fbf5132c2993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:56.628260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545dd2-bda4-4d1e-a532-fbf5132c2993 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:56.628536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545dd2-bda4-4d1e-a532-fbf5132c2993 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:56.628958 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545dd2-bda4-4d1e-a532-fbf5132c2993 None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:56.630840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac545dd2-bda4-4d1e-a532-fbf5132c2993 None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:56.632324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac545dd2-bda4-4d1e-a532-fbf5132c2993 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:56.635391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 184/368] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:24:56 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:56.636236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545dd2-bda4-4d1e-a532-fbf5132c2993 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:56.688337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b5751-3d28-43a7-ac72-5e1d2a2a2ecc None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:56.734536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810db7b4-7c1d-4247-9238-394acbf73e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:56.736693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810db7b4-7c1d-4247-9238-394acbf73e8d None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:56.737429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810db7b4-7c1d-4247-9238-394acbf73e8d None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:56.737843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810db7b4-7c1d-4247-9238-394acbf73e8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:56.753059 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810db7b4-7c1d-4247-9238-394acbf73e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:56.762376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-810db7b4-7c1d-4247-9238-394acbf73e8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:24:56.764304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 185/369] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:24:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:56.765480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810db7b4-7c1d-4247-9238-394acbf73e8d None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:56.777467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545dd2-bda4-4d1e-a532-fbf5132c2993 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:56.819796 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e4cb9-0b41-4c5c-8316-d6eb0f96efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:56.820699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4cb9-0b41-4c5c-8316-d6eb0f96efbc None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:56.821113 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4cb9-0b41-4c5c-8316-d6eb0f96efbc None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:56.821550 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4cb9-0b41-4c5c-8316-d6eb0f96efbc None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:56.822426 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e4cb9-0b41-4c5c-8316-d6eb0f96efbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:56.822865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e4cb9-0b41-4c5c-8316-d6eb0f96efbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:56.825180 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e4cb9-0b41-4c5c-8316-d6eb0f96efbc None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:56.834894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 185/370] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:24:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:56.835767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e4cb9-0b41-4c5c-8316-d6eb0f96efbc None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:56.883994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810db7b4-7c1d-4247-9238-394acbf73e8d None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:56.926492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc99a3-b9d3-4134-9bab-e720c7d054c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:56.927550 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc99a3-b9d3-4134-9bab-e720c7d054c9 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:56.928257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc99a3-b9d3-4134-9bab-e720c7d054c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:56.928694 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc99a3-b9d3-4134-9bab-e720c7d054c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:56.929671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc99a3-b9d3-4134-9bab-e720c7d054c9 None admin] RBAC: Adding query filter params (group.id=fb48d522c45744b3beb13f7907b84aba, role.id=f8641f824b324fa2956c5fc5b764f8ae, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:56.930121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc99a3-b9d3-4134-9bab-e720c7d054c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:56.932488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc99a3-b9d3-4134-9bab-e720c7d054c9 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:56.941475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 186/371] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Feb 28 10:24:56 2022] GET /identity/v3/role_assignments?group.id=fb48d522c45744b3beb13f7907b84aba&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:56.943126 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e4cb9-0b41-4c5c-8316-d6eb0f96efbc None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:56.943865 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc99a3-b9d3-4134-9bab-e720c7d054c9 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:57.007024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341e48d-ac79-4d5c-bb98-72e630f6e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:57.007722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e48d-ac79-4d5c-bb98-72e630f6e590 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:57.015134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e48d-ac79-4d5c-bb98-72e630f6e590 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:57.015530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e48d-ac79-4d5c-bb98-72e630f6e590 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:57.016391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341e48d-ac79-4d5c-bb98-72e630f6e590 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:57.016708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341e48d-ac79-4d5c-bb98-72e630f6e590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:57.018118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341e48d-ac79-4d5c-bb98-72e630f6e590 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:57.035255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 186/372] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:57.041170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341e48d-ac79-4d5c-bb98-72e630f6e590 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:57.086266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc99a3-b9d3-4134-9bab-e720c7d054c9 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:57.127733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac822f29-8698-486c-80b1-99ccb6b7546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:57.128449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac822f29-8698-486c-80b1-99ccb6b7546d None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:57.128736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac822f29-8698-486c-80b1-99ccb6b7546d None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:57.129015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac822f29-8698-486c-80b1-99ccb6b7546d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:57.208443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac822f29-8698-486c-80b1-99ccb6b7546d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:57.209830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac822f29-8698-486c-80b1-99ccb6b7546d None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:57.241934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341e48d-ac79-4d5c-bb98-72e630f6e590 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:57.312461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d8ccf-a4d5-483e-b9ed-3e8935d55355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:57.313137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d8ccf-a4d5-483e-b9ed-3e8935d55355 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:57.313457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d8ccf-a4d5-483e-b9ed-3e8935d55355 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:57.313732 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d8ccf-a4d5-483e-b9ed-3e8935d55355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:57.345410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 187/373] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:57.353664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac822f29-8698-486c-80b1-99ccb6b7546d None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:57.444561 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d8ccf-a4d5-483e-b9ed-3e8935d55355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:57.446020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d8ccf-a4d5-483e-b9ed-3e8935d55355 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:57.527081 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac822f29-8698-486c-80b1-99ccb6b7546d None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:57.575414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e149e-dee3-4b21-b56a-77aa70cac0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:57.576895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e149e-dee3-4b21-b56a-77aa70cac0b5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:57.577381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e149e-dee3-4b21-b56a-77aa70cac0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:57.577978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e149e-dee3-4b21-b56a-77aa70cac0b5 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:57.579456 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e149e-dee3-4b21-b56a-77aa70cac0b5 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:57.581095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e149e-dee3-4b21-b56a-77aa70cac0b5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:57.583299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 188/374] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:57 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:57.591085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e149e-dee3-4b21-b56a-77aa70cac0b5 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:57.654486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 187/375] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:24:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:24:57.659831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d8ccf-a4d5-483e-b9ed-3e8935d55355 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:57.766344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d8ccf-a4d5-483e-b9ed-3e8935d55355 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:57.804751 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e149e-dee3-4b21-b56a-77aa70cac0b5 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:57.805412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5e6fd-257f-411c-aaae-dfffadbd5d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:57.806266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5e6fd-257f-411c-aaae-dfffadbd5d2a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:57.806544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5e6fd-257f-411c-aaae-dfffadbd5d2a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:57.806804 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5e6fd-257f-411c-aaae-dfffadbd5d2a None admin] PATH_INFO: `/v3/projects/df99af6079f04b40ae2fb2b304eafd0e` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:57.808063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5e6fd-257f-411c-aaae-dfffadbd5d2a None admin] RBAC: Authorizing `identity:get_project(project_id=df99af6079f04b40ae2fb2b304eafd0e)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:57.809499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5e6fd-257f-411c-aaae-dfffadbd5d2a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:57.811502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 188/376] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:57 2022] GET /identity/v3/projects/df99af6079f04b40ae2fb2b304eafd0e => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:57.816736 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5e6fd-257f-411c-aaae-dfffadbd5d2a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:57.863663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c80a2-66fc-46c5-9224-8ac603d27b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:57.864570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c80a2-66fc-46c5-9224-8ac603d27b71 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:57.864855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c80a2-66fc-46c5-9224-8ac603d27b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:57.865126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c80a2-66fc-46c5-9224-8ac603d27b71 None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:57.870425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c80a2-66fc-46c5-9224-8ac603d27b71 None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:57.871901 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c80a2-66fc-46c5-9224-8ac603d27b71 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:57.873961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 189/377] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:24:57 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:57.880241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c80a2-66fc-46c5-9224-8ac603d27b71 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:57.929490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5e6fd-257f-411c-aaae-dfffadbd5d2a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:57.964221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17ab6e-388f-4c90-9580-ded49563c576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:57.965089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17ab6e-388f-4c90-9580-ded49563c576 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:57.965369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17ab6e-388f-4c90-9580-ded49563c576 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:57.965642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17ab6e-388f-4c90-9580-ded49563c576 None admin] PATH_INFO: `/v3/groups/e1afef9b0936409a94f2c79fbc8dcc29` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:57.971973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17ab6e-388f-4c90-9580-ded49563c576 None admin] RBAC: Authorizing `identity:get_group(group_id=e1afef9b0936409a94f2c79fbc8dcc29)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:57.973441 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17ab6e-388f-4c90-9580-ded49563c576 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:57.975227 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 189/378] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:24:57 2022] GET /identity/v3/groups/e1afef9b0936409a94f2c79fbc8dcc29 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:57.981048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17ab6e-388f-4c90-9580-ded49563c576 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:58.040833 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c80a2-66fc-46c5-9224-8ac603d27b71 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:58.081784 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6d66a-cdc2-425b-ac64-3b92e4f76773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:58.082803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6d66a-cdc2-425b-ac64-3b92e4f76773 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:58.083347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6d66a-cdc2-425b-ac64-3b92e4f76773 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:58.083763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6d66a-cdc2-425b-ac64-3b92e4f76773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:58.084743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6d66a-cdc2-425b-ac64-3b92e4f76773 None admin] RBAC: Adding query filter params (group.id=fb48d522c45744b3beb13f7907b84aba, role.id=79396755fc0842a882775515d6feab13, scope.project.id=c02cb7cef6b84d34815a0826d3396e94) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:58.086121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6d66a-cdc2-425b-ac64-3b92e4f76773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:58.088762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6d66a-cdc2-425b-ac64-3b92e4f76773 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:58.102398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 190/379] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Feb 28 10:24:57 2022] GET /identity/v3/role_assignments?group.id=fb48d522c45744b3beb13f7907b84aba&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=79396755fc0842a882775515d6feab13 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:58.143767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17ab6e-388f-4c90-9580-ded49563c576 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:58.200011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a43ccf-bb24-41db-9f7f-a3e0e8d02812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:58.200685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a43ccf-bb24-41db-9f7f-a3e0e8d02812 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:58.200963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a43ccf-bb24-41db-9f7f-a3e0e8d02812 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:58.201236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a43ccf-bb24-41db-9f7f-a3e0e8d02812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:58.202074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a43ccf-bb24-41db-9f7f-a3e0e8d02812 None admin] RBAC: Adding query filter params (group.id=e1afef9b0936409a94f2c79fbc8dcc29, role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=df99af6079f04b40ae2fb2b304eafd0e) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:58.202382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a43ccf-bb24-41db-9f7f-a3e0e8d02812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:58.204449 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a43ccf-bb24-41db-9f7f-a3e0e8d02812 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:58.215897 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 190/380] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Feb 28 10:24:57 2022] GET /identity/v3/role_assignments?group.id=e1afef9b0936409a94f2c79fbc8dcc29&scope.project.id=df99af6079f04b40ae2fb2b304eafd0e&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:24:58.704019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3997f6-9a07-4cfb-8b3b-3f786e7407e1 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:58.704385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3997f6-9a07-4cfb-8b3b-3f786e7407e1 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:58.704559 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3997f6-9a07-4cfb-8b3b-3f786e7407e1 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:58.706692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 191/381] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:58.712009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc06046-8ff8-4071-bebd-219a05ee1ac5 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:58.712554 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc06046-8ff8-4071-bebd-219a05ee1ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:58.713041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc06046-8ff8-4071-bebd-219a05ee1ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:58.735757 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-4cc06046-8ff8-4071-bebd-219a05ee1ac5 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:58.736936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-4cc06046-8ff8-4071-bebd-219a05ee1ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:58.808512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 191/382] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:58.839758 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3997f6-9a07-4cfb-8b3b-3f786e7407e1 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:58.972580 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3997f6-9a07-4cfb-8b3b-3f786e7407e1 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:59.010546 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654017a0-5303-4c1d-b75c-0670b3972cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:59.011368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654017a0-5303-4c1d-b75c-0670b3972cab None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:59.011652 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654017a0-5303-4c1d-b75c-0670b3972cab None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:59.011921 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654017a0-5303-4c1d-b75c-0670b3972cab None admin] PATH_INFO: `/v3/roles/member` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:59.027781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654017a0-5303-4c1d-b75c-0670b3972cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:24:59.034727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-654017a0-5303-4c1d-b75c-0670b3972cab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:24:59.035958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 192/383] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:24:59.041961 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc06046-8ff8-4071-bebd-219a05ee1ac5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:59.198741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc06046-8ff8-4071-bebd-219a05ee1ac5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:59.242484 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0f8d-afc8-4d38-abca-1e45c3bcfe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:59.243160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0f8d-afc8-4d38-abca-1e45c3bcfe13 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:59.243437 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0f8d-afc8-4d38-abca-1e45c3bcfe13 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:59.243701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0f8d-afc8-4d38-abca-1e45c3bcfe13 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:59.244441 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af0f8d-afc8-4d38-abca-1e45c3bcfe13 None admin] RBAC: Adding query filter params (name=member) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:24:59.244735 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af0f8d-afc8-4d38-abca-1e45c3bcfe13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:59.246093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af0f8d-afc8-4d38-abca-1e45c3bcfe13 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:59.259021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 192/384] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:24:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:59.261417 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654017a0-5303-4c1d-b75c-0670b3972cab None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:59.399713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654017a0-5303-4c1d-b75c-0670b3972cab None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:59.442356 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d947bae-cfc5-4118-a42d-e8b0be042ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:59.443311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947bae-cfc5-4118-a42d-e8b0be042ae0 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:59.443589 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947bae-cfc5-4118-a42d-e8b0be042ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:59.443864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947bae-cfc5-4118-a42d-e8b0be042ae0 None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:59.445070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d947bae-cfc5-4118-a42d-e8b0be042ae0 None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:59.446500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d947bae-cfc5-4118-a42d-e8b0be042ae0 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:59.448455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 193/385] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:24:59 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:59.454420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0f8d-afc8-4d38-abca-1e45c3bcfe13 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:59.560215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd765a-e26d-4898-a76c-8174c53f71f5 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:59.560500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd765a-e26d-4898-a76c-8174c53f71f5 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:59.560685 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd765a-e26d-4898-a76c-8174c53f71f5 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:59.562435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 194/386] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:59.570053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941402a-3b68-49aa-b212-ea0fbc942663 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:59.570324 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941402a-3b68-49aa-b212-ea0fbc942663 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:59.570601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941402a-3b68-49aa-b212-ea0fbc942663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:59.595365 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c941402a-3b68-49aa-b212-ea0fbc942663 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:59.597007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c941402a-3b68-49aa-b212-ea0fbc942663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:59.645561 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0f8d-afc8-4d38-abca-1e45c3bcfe13 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:59.718924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1243ee-894d-4204-a50e-a6c675c44f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:59.719831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1243ee-894d-4204-a50e-a6c675c44f32 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:59.720111 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1243ee-894d-4204-a50e-a6c675c44f32 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:59.720390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1243ee-894d-4204-a50e-a6c675c44f32 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:59.722240 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1243ee-894d-4204-a50e-a6c675c44f32 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:59.723697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1243ee-894d-4204-a50e-a6c675c44f32 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:59.725388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 193/387] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:24:59 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:24:59.731205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1243ee-894d-4204-a50e-a6c675c44f32 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:59.735971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 195/388] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:24:59.774574 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941402a-3b68-49aa-b212-ea0fbc942663 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:59.904537 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1243ee-894d-4204-a50e-a6c675c44f32 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:59.947724 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941402a-3b68-49aa-b212-ea0fbc942663 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:59.971714 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0619f9-1c45-4cf6-acd4-3dee033e2569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:59.972960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0619f9-1c45-4cf6-acd4-3dee033e2569 None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:59.973410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0619f9-1c45-4cf6-acd4-3dee033e2569 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:59.973850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0619f9-1c45-4cf6-acd4-3dee033e2569 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94/groups/fb48d522c45744b3beb13f7907b84aba/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:59.976021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0619f9-1c45-4cf6-acd4-3dee033e2569 None admin] RBAC: Authorizing `identity:create_grant(project_id=c02cb7cef6b84d34815a0826d3396e94, group_id=fb48d522c45744b3beb13f7907b84aba, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:59.982661 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0619f9-1c45-4cf6-acd4-3dee033e2569 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:59.986224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba6ac5-b223-47c8-a87f-cc9ee2724d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:59.987449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba6ac5-b223-47c8-a87f-cc9ee2724d03 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:59.987449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba6ac5-b223-47c8-a87f-cc9ee2724d03 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:59.987827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba6ac5-b223-47c8-a87f-cc9ee2724d03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:59.999835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba6ac5-b223-47c8-a87f-cc9ee2724d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:00.005517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 194/389] 10.222.0.44 () {58 vars in 1442 bytes} [Mon Feb 28 10:24:59 2022] PUT /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94/groups/fb48d522c45744b3beb13f7907b84aba/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:25:00.009580 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-48ba6ac5-b223-47c8-a87f-cc9ee2724d03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:25:00.011386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 196/390] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:24:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:00.017801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0619f9-1c45-4cf6-acd4-3dee033e2569 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:00.109946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44060c8-1de2-4f90-b23c-970c8623175d None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:00.110647 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44060c8-1de2-4f90-b23c-970c8623175d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:00.111194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44060c8-1de2-4f90-b23c-970c8623175d None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:00.113200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 197/391] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:00.119136 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1288e99-5309-45d8-ae29-423247a7e5cd None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:00.119719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1288e99-5309-45d8-ae29-423247a7e5cd None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:00.120215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1288e99-5309-45d8-ae29-423247a7e5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:00.143377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c1288e99-5309-45d8-ae29-423247a7e5cd None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:00.144884 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c1288e99-5309-45d8-ae29-423247a7e5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:00.162370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0619f9-1c45-4cf6-acd4-3dee033e2569 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:00.202950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ac42a-1f3e-4cc4-8ca2-8d7f394404c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:00.203497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac42a-1f3e-4cc4-8ca2-8d7f394404c0 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:00.203851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac42a-1f3e-4cc4-8ca2-8d7f394404c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:00.204122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac42a-1f3e-4cc4-8ca2-8d7f394404c0 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:00.204869 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ac42a-1f3e-4cc4-8ca2-8d7f394404c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:00.205169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ac42a-1f3e-4cc4-8ca2-8d7f394404c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:00.206536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ac42a-1f3e-4cc4-8ca2-8d7f394404c0 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:00.215301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 195/392] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:00.218740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 198/393] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:25:00.223009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ac42a-1f3e-4cc4-8ca2-8d7f394404c0 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:00.243806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1288e99-5309-45d8-ae29-423247a7e5cd None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:00.349369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ac42a-1f3e-4cc4-8ca2-8d7f394404c0 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:00.383268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1288e99-5309-45d8-ae29-423247a7e5cd None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:00.392188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17e675-5f01-4573-b428-fb5afc3fe8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:00.393059 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17e675-5f01-4573-b428-fb5afc3fe8e7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:00.393331 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17e675-5f01-4573-b428-fb5afc3fe8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:00.393601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17e675-5f01-4573-b428-fb5afc3fe8e7 None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:00.396460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17e675-5f01-4573-b428-fb5afc3fe8e7 None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:00.399134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17e675-5f01-4573-b428-fb5afc3fe8e7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:00.401706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 196/394] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:25:00 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:00.407638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17e675-5f01-4573-b428-fb5afc3fe8e7 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:00.445188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce04d43-9bf6-43bb-adbf-670cd02b7adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:00.446523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce04d43-9bf6-43bb-adbf-670cd02b7adb None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:00.446805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce04d43-9bf6-43bb-adbf-670cd02b7adb None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:00.447099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce04d43-9bf6-43bb-adbf-670cd02b7adb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:00.462345 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce04d43-9bf6-43bb-adbf-670cd02b7adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:00.469677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-0ce04d43-9bf6-43bb-adbf-670cd02b7adb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:25:00.471241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 199/395] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:00.476770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce04d43-9bf6-43bb-adbf-670cd02b7adb None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:00.573923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17e675-5f01-4573-b428-fb5afc3fe8e7 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:00.612541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860959cc-b886-434a-8cd8-0e2c042ee652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:00.613750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860959cc-b886-434a-8cd8-0e2c042ee652 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:00.614077 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce04d43-9bf6-43bb-adbf-670cd02b7adb None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:00.614441 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860959cc-b886-434a-8cd8-0e2c042ee652 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:00.614935 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860959cc-b886-434a-8cd8-0e2c042ee652 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:00.616371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860959cc-b886-434a-8cd8-0e2c042ee652 None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:00.617996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860959cc-b886-434a-8cd8-0e2c042ee652 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:00.620220 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 197/396] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:25:00 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:00.625851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860959cc-b886-434a-8cd8-0e2c042ee652 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:00.675608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3d4ac-b3fe-450f-9201-0388708bab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:00.676281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3d4ac-b3fe-450f-9201-0388708bab66 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:00.676561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3d4ac-b3fe-450f-9201-0388708bab66 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:00.677072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3d4ac-b3fe-450f-9201-0388708bab66 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:00.677575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3d4ac-b3fe-450f-9201-0388708bab66 None admin] RBAC: Adding query filter params (name=member) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:00.677878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3d4ac-b3fe-450f-9201-0388708bab66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:00.679292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3d4ac-b3fe-450f-9201-0388708bab66 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:00.696477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 200/397] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:25:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:00.704669 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3d4ac-b3fe-450f-9201-0388708bab66 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:00.744742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860959cc-b886-434a-8cd8-0e2c042ee652 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:00.821547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3d4ac-b3fe-450f-9201-0388708bab66 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:00.822414 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5a9e0-de06-480e-9ac3-262a3586bac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:00.823587 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a9e0-de06-480e-9ac3-262a3586bac4 None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:00.824082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a9e0-de06-480e-9ac3-262a3586bac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:00.824623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a9e0-de06-480e-9ac3-262a3586bac4 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/groups/fb48d522c45744b3beb13f7907b84aba/roles/79396755fc0842a882775515d6feab13` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:00.833208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5a9e0-de06-480e-9ac3-262a3586bac4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c72151b764de430b89f44fcf9d7e9dbb, group_id=fb48d522c45744b3beb13f7907b84aba, role_id=79396755fc0842a882775515d6feab13)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:00.835109 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5a9e0-de06-480e-9ac3-262a3586bac4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:00.859817 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 198/398] 10.222.0.44 () {58 vars in 1442 bytes} [Mon Feb 28 10:25:00 2022] PUT /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/groups/fb48d522c45744b3beb13f7907b84aba/roles/79396755fc0842a882775515d6feab13 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:25:00.873139 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5f2f6-6daa-4d77-86e7-1c17c8b14472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:00.874469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f2f6-6daa-4d77-86e7-1c17c8b14472 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:00.875069 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f2f6-6daa-4d77-86e7-1c17c8b14472 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:00.876117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f2f6-6daa-4d77-86e7-1c17c8b14472 None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:00.877772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5f2f6-6daa-4d77-86e7-1c17c8b14472 None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:00.879574 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5f2f6-6daa-4d77-86e7-1c17c8b14472 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:00.881855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 201/399] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:25:00 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:00.887929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5a9e0-de06-480e-9ac3-262a3586bac4 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:00.994611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5a9e0-de06-480e-9ac3-262a3586bac4 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:01.031143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eeef73-ee5a-4a6b-8077-f3dbfc7c5257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:01.032429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eeef73-ee5a-4a6b-8077-f3dbfc7c5257 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:01.032909 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eeef73-ee5a-4a6b-8077-f3dbfc7c5257 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:01.033424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eeef73-ee5a-4a6b-8077-f3dbfc7c5257 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:01.035077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eeef73-ee5a-4a6b-8077-f3dbfc7c5257 None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:01.036842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eeef73-ee5a-4a6b-8077-f3dbfc7c5257 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:01.038821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 199/400] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:25:00 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:01.044835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5f2f6-6daa-4d77-86e7-1c17c8b14472 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:01.122573 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced6f63-bfc0-4dd7-b971-1bcdde9b89e1 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:01.123230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced6f63-bfc0-4dd7-b971-1bcdde9b89e1 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:01.123705 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced6f63-bfc0-4dd7-b971-1bcdde9b89e1 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:01.125719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 200/401] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:01.133629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf490d-f701-419b-998e-377550b8bdf2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:01.134263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf490d-f701-419b-998e-377550b8bdf2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:01.135059 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf490d-f701-419b-998e-377550b8bdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:01.155698 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-faaf490d-f701-419b-998e-377550b8bdf2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:01.157656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-faaf490d-f701-419b-998e-377550b8bdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:01.177906 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5f2f6-6daa-4d77-86e7-1c17c8b14472 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:01.224399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b2beb-dcca-43d1-86df-5f8d609d6ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:01.227731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b2beb-dcca-43d1-86df-5f8d609d6ab5 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:01.227731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b2beb-dcca-43d1-86df-5f8d609d6ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:01.227731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b2beb-dcca-43d1-86df-5f8d609d6ab5 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/groups/fb48d522c45744b3beb13f7907b84aba/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:01.227995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b2beb-dcca-43d1-86df-5f8d609d6ab5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c72151b764de430b89f44fcf9d7e9dbb, group_id=fb48d522c45744b3beb13f7907b84aba, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:01.229303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b2beb-dcca-43d1-86df-5f8d609d6ab5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:01.247715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 202/402] 10.222.0.44 () {58 vars in 1442 bytes} [Mon Feb 28 10:25:01 2022] PUT /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb/groups/fb48d522c45744b3beb13f7907b84aba/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:25:01.248639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 201/403] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:01.249064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41052b6-a072-4747-b738-d6e708d02ee0 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:01.249237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41052b6-a072-4747-b738-d6e708d02ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:01.249505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41052b6-a072-4747-b738-d6e708d02ee0 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:01.260489 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 203/404] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:01 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:01.265998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3423-5601-4868-8b34-4725f96658e3 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:01.266391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3423-5601-4868-8b34-4725f96658e3 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:01.266671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3423-5601-4868-8b34-4725f96658e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:01.289582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41052b6-a072-4747-b738-d6e708d02ee0 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:01.295006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-705e3423-5601-4868-8b34-4725f96658e3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:01.296209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-705e3423-5601-4868-8b34-4725f96658e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:01.377043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 202/405] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:01.411697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e3423-5601-4868-8b34-4725f96658e3 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:01.496535 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41052b6-a072-4747-b738-d6e708d02ee0 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:01.539961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a1453-6782-48e3-ae9b-6f48c47fb628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:01.540960 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1453-6782-48e3-ae9b-6f48c47fb628 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:01.541247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1453-6782-48e3-ae9b-6f48c47fb628 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:01.541520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1453-6782-48e3-ae9b-6f48c47fb628 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:01.542613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e3423-5601-4868-8b34-4725f96658e3 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:01.553471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a1453-6782-48e3-ae9b-6f48c47fb628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:01.563537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-902a1453-6782-48e3-ae9b-6f48c47fb628 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:25:01.565260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 204/406] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:01.570835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a1453-6782-48e3-ae9b-6f48c47fb628 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:01.598152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00559c-c1f4-48ed-9e54-f60e4bc4b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:01.599027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00559c-c1f4-48ed-9e54-f60e4bc4b48e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:01.599303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00559c-c1f4-48ed-9e54-f60e4bc4b48e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:01.599566 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00559c-c1f4-48ed-9e54-f60e4bc4b48e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:01.619825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00559c-c1f4-48ed-9e54-f60e4bc4b48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:01.631997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-1a00559c-c1f4-48ed-9e54-f60e4bc4b48e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:25:01.633456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 203/407] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:01.639708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00559c-c1f4-48ed-9e54-f60e4bc4b48e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:01.710593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a1453-6782-48e3-ae9b-6f48c47fb628 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:01.747711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522967cb-7ad7-4d33-a01b-507981bc36d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:01.748512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522967cb-7ad7-4d33-a01b-507981bc36d7 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:01.748836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522967cb-7ad7-4d33-a01b-507981bc36d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:01.749202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522967cb-7ad7-4d33-a01b-507981bc36d7 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:01.749951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522967cb-7ad7-4d33-a01b-507981bc36d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:01.750257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522967cb-7ad7-4d33-a01b-507981bc36d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:01.752348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522967cb-7ad7-4d33-a01b-507981bc36d7 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:01.761674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 205/408] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:01.767939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522967cb-7ad7-4d33-a01b-507981bc36d7 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:01.872826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00559c-c1f4-48ed-9e54-f60e4bc4b48e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:01.873049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522967cb-7ad7-4d33-a01b-507981bc36d7 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:01.927220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b97df8-ddee-490c-ba8d-5f49527e0d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:01.928072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b97df8-ddee-490c-ba8d-5f49527e0d98 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:01.928351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b97df8-ddee-490c-ba8d-5f49527e0d98 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:01.928627 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b97df8-ddee-490c-ba8d-5f49527e0d98 None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:01.931069 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f180d9c-f4b0-4bc9-9043-74685a6dc85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:01.931729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f180d9c-f4b0-4bc9-9043-74685a6dc85b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:01.932001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f180d9c-f4b0-4bc9-9043-74685a6dc85b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:01.932269 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f180d9c-f4b0-4bc9-9043-74685a6dc85b None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:01.933011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f180d9c-f4b0-4bc9-9043-74685a6dc85b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:01.933316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f180d9c-f4b0-4bc9-9043-74685a6dc85b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:01.934678 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f180d9c-f4b0-4bc9-9043-74685a6dc85b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:01.936677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b97df8-ddee-490c-ba8d-5f49527e0d98 None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:01.938699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b97df8-ddee-490c-ba8d-5f49527e0d98 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:01.940336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 206/409] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:25:01 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:01.952104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 204/410] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:01.953441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b97df8-ddee-490c-ba8d-5f49527e0d98 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:01.958029 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f180d9c-f4b0-4bc9-9043-74685a6dc85b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:02.138248 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b97df8-ddee-490c-ba8d-5f49527e0d98 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:02.145052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f180d9c-f4b0-4bc9-9043-74685a6dc85b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:02.183875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45abf3-bda7-4683-84d0-852fa8da26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:02.186070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45abf3-bda7-4683-84d0-852fa8da26cb None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:02.186351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45abf3-bda7-4683-84d0-852fa8da26cb None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:02.186625 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45abf3-bda7-4683-84d0-852fa8da26cb None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:02.189616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45abf3-bda7-4683-84d0-852fa8da26cb None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:02.191085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45abf3-bda7-4683-84d0-852fa8da26cb None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:02.192763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 207/411] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:25:01 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:02.204397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45abf3-bda7-4683-84d0-852fa8da26cb None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:02.207504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146804ad-6d92-407e-a704-2c956b961587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:02.208358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146804ad-6d92-407e-a704-2c956b961587 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:02.208635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146804ad-6d92-407e-a704-2c956b961587 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:02.208904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146804ad-6d92-407e-a704-2c956b961587 None admin] PATH_INFO: `/v3/groups/e1afef9b0936409a94f2c79fbc8dcc29` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:02.210859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146804ad-6d92-407e-a704-2c956b961587 None admin] RBAC: Authorizing `identity:get_group(group_id=e1afef9b0936409a94f2c79fbc8dcc29)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:02.217074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146804ad-6d92-407e-a704-2c956b961587 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:02.218760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 205/412] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:25:01 2022] GET /identity/v3/groups/e1afef9b0936409a94f2c79fbc8dcc29 => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:02.224121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146804ad-6d92-407e-a704-2c956b961587 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:02.370529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45abf3-bda7-4683-84d0-852fa8da26cb None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:02.410222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a1724-4cfa-4a6b-a310-df1a9f8a0c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:02.411706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a1724-4cfa-4a6b-a310-df1a9f8a0c24 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:02.412624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a1724-4cfa-4a6b-a310-df1a9f8a0c24 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:02.412911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a1724-4cfa-4a6b-a310-df1a9f8a0c24 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94/groups/fb48d522c45744b3beb13f7907b84aba/roles/79396755fc0842a882775515d6feab13` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:02.417434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a1724-4cfa-4a6b-a310-df1a9f8a0c24 None admin] RBAC: Authorizing `identity:create_grant(project_id=c02cb7cef6b84d34815a0826d3396e94, group_id=fb48d522c45744b3beb13f7907b84aba, role_id=79396755fc0842a882775515d6feab13)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:02.418865 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a1724-4cfa-4a6b-a310-df1a9f8a0c24 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:02.423565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146804ad-6d92-407e-a704-2c956b961587 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:02.452148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 208/413] 10.222.0.44 () {58 vars in 1442 bytes} [Mon Feb 28 10:25:02 2022] PUT /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94/groups/fb48d522c45744b3beb13f7907b84aba/roles/79396755fc0842a882775515d6feab13 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:25:02.457603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc6bd4-6f5a-441a-8af6-19a96a56b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:02.458521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6bd4-6f5a-441a-8af6-19a96a56b6cd None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:02.458799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6bd4-6f5a-441a-8af6-19a96a56b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:02.459133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6bd4-6f5a-441a-8af6-19a96a56b6cd None admin] PATH_INFO: `/v3/projects/df99af6079f04b40ae2fb2b304eafd0e` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:02.460386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc6bd4-6f5a-441a-8af6-19a96a56b6cd None admin] RBAC: Authorizing `identity:get_project(project_id=df99af6079f04b40ae2fb2b304eafd0e)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:02.461903 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc6bd4-6f5a-441a-8af6-19a96a56b6cd None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:02.464140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 206/414] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:25:02 2022] GET /identity/v3/projects/df99af6079f04b40ae2fb2b304eafd0e => generated 344 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:02.469927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a1724-4cfa-4a6b-a310-df1a9f8a0c24 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:02.610988 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a1724-4cfa-4a6b-a310-df1a9f8a0c24 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:02.665824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d4653-a1b8-4b14-a10b-09c557a31f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:02.667038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4653-a1b8-4b14-a10b-09c557a31f70 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:02.667527 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4653-a1b8-4b14-a10b-09c557a31f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:02.668193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4653-a1b8-4b14-a10b-09c557a31f70 None admin] PATH_INFO: `/v3/projects/df99af6079f04b40ae2fb2b304eafd0e/groups/e1afef9b0936409a94f2c79fbc8dcc29/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:02.671783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d4653-a1b8-4b14-a10b-09c557a31f70 None admin] RBAC: Authorizing `identity:create_grant(project_id=df99af6079f04b40ae2fb2b304eafd0e, group_id=e1afef9b0936409a94f2c79fbc8dcc29, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:02.674965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d4653-a1b8-4b14-a10b-09c557a31f70 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:02.693863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 209/415] 10.222.0.44 () {58 vars in 1442 bytes} [Mon Feb 28 10:25:02 2022] PUT /identity/v3/projects/df99af6079f04b40ae2fb2b304eafd0e/groups/e1afef9b0936409a94f2c79fbc8dcc29/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:25:02.942689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74276b-8956-4cf5-ae44-aca011fcf650 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:02.943253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74276b-8956-4cf5-ae44-aca011fcf650 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:02.943764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74276b-8956-4cf5-ae44-aca011fcf650 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:02.946000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 207/416] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:02.951323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dd168-aa32-46fb-8b3e-f28b159cf5c8 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:02.951922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dd168-aa32-46fb-8b3e-f28b159cf5c8 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:02.952723 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dd168-aa32-46fb-8b3e-f28b159cf5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:02.974865 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-179dd168-aa32-46fb-8b3e-f28b159cf5c8 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:02.976390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-179dd168-aa32-46fb-8b3e-f28b159cf5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:03.053769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 210/417] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:03.097224 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74276b-8956-4cf5-ae44-aca011fcf650 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:03.248287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74276b-8956-4cf5-ae44-aca011fcf650 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:03.296133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188f3fe-82c4-4b86-a176-d73aea8813c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:03.296935 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188f3fe-82c4-4b86-a176-d73aea8813c4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:03.297213 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188f3fe-82c4-4b86-a176-d73aea8813c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:03.297519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188f3fe-82c4-4b86-a176-d73aea8813c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:03.308761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188f3fe-82c4-4b86-a176-d73aea8813c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:03.320287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-6188f3fe-82c4-4b86-a176-d73aea8813c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:25:03.321923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 208/418] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:03.327413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dd168-aa32-46fb-8b3e-f28b159cf5c8 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:03.545778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dd168-aa32-46fb-8b3e-f28b159cf5c8 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:03.596469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5768ed7-edd1-4dcb-bcce-7912b0cf2b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:03.597137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5768ed7-edd1-4dcb-bcce-7912b0cf2b03 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:03.597414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5768ed7-edd1-4dcb-bcce-7912b0cf2b03 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:03.597686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5768ed7-edd1-4dcb-bcce-7912b0cf2b03 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:03.598426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5768ed7-edd1-4dcb-bcce-7912b0cf2b03 None admin] RBAC: Adding query filter params (name=member) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:03.598728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5768ed7-edd1-4dcb-bcce-7912b0cf2b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:03.600110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5768ed7-edd1-4dcb-bcce-7912b0cf2b03 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:03.615014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 211/419] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:03.620135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188f3fe-82c4-4b86-a176-d73aea8813c4 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:03.750201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188f3fe-82c4-4b86-a176-d73aea8813c4 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:03.799328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd04e9-97fa-4afe-ae44-87a90d8cd188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:03.799906 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd04e9-97fa-4afe-ae44-87a90d8cd188 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:03.800193 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd04e9-97fa-4afe-ae44-87a90d8cd188 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:03.800468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd04e9-97fa-4afe-ae44-87a90d8cd188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:03.831105 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f326161-4e4c-454c-a32a-e25ad6eaf5ed None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:03.831435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f326161-4e4c-454c-a32a-e25ad6eaf5ed None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:03.831664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f326161-4e4c-454c-a32a-e25ad6eaf5ed None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:03.835800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 212/420] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:03.840928 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4bb86-b822-498f-98c8-29ab62e28b62 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:03.841289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4bb86-b822-498f-98c8-29ab62e28b62 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:03.841641 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4bb86-b822-498f-98c8-29ab62e28b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:03.872611 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-85e4bb86-b822-498f-98c8-29ab62e28b62 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:03.873800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-85e4bb86-b822-498f-98c8-29ab62e28b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:03.926929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd04e9-97fa-4afe-ae44-87a90d8cd188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:03.931450 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd04e9-97fa-4afe-ae44-87a90d8cd188 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:03.996294 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 213/421] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:25:03.997471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf35ab8-4505-440e-a2e6-10fe20064e03 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:03.997757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf35ab8-4505-440e-a2e6-10fe20064e03 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:03.998030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf35ab8-4505-440e-a2e6-10fe20064e03 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:03.999833 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 214/422] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:04.016839 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06908f8f-22d8-4c7c-85bb-94757c698e6d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:04.017148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06908f8f-22d8-4c7c-85bb-94757c698e6d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:04.017393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06908f8f-22d8-4c7c-85bb-94757c698e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:04.040564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-06908f8f-22d8-4c7c-85bb-94757c698e6d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:04.041744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-06908f8f-22d8-4c7c-85bb-94757c698e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:04.069824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 209/423] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:04.075418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd04e9-97fa-4afe-ae44-87a90d8cd188 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:04.119361 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 215/424] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:04.120538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06908f8f-22d8-4c7c-85bb-94757c698e6d None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:04.212436 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd04e9-97fa-4afe-ae44-87a90d8cd188 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:04.232299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06908f8f-22d8-4c7c-85bb-94757c698e6d None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:04.255118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4338436-50ce-43a4-a6cd-b83722016af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:04.256179 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4338436-50ce-43a4-a6cd-b83722016af9 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:04.256529 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4338436-50ce-43a4-a6cd-b83722016af9 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:04.257119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4338436-50ce-43a4-a6cd-b83722016af9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:04.267883 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f7c72-af24-433c-a842-30b09bde6231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:04.268958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7c72-af24-433c-a842-30b09bde6231 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:04.269608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7c72-af24-433c-a842-30b09bde6231 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:04.269893 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4338436-50ce-43a4-a6cd-b83722016af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:04.270305 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7c72-af24-433c-a842-30b09bde6231 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:04.271719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f7c72-af24-433c-a842-30b09bde6231 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:04.273453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f7c72-af24-433c-a842-30b09bde6231 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:04.275350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 216/425] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:25:04 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:04.276300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f7c72-af24-433c-a842-30b09bde6231 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:04.279388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e4338436-50ce-43a4-a6cd-b83722016af9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:25:04.286387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 210/426] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:04.286387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4338436-50ce-43a4-a6cd-b83722016af9 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:04.393043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f7c72-af24-433c-a842-30b09bde6231 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:04.399689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4338436-50ce-43a4-a6cd-b83722016af9 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:04.434842 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e641-8d5d-40c6-8bee-ad8570462a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:04.436018 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e641-8d5d-40c6-8bee-ad8570462a9f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:04.436500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e641-8d5d-40c6-8bee-ad8570462a9f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:04.436970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e641-8d5d-40c6-8bee-ad8570462a9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:04.442857 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56db51c-c66f-4833-a472-0b48fee0ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:04.443840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56db51c-c66f-4833-a472-0b48fee0ef5f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:04.444121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56db51c-c66f-4833-a472-0b48fee0ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:04.444388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56db51c-c66f-4833-a472-0b48fee0ef5f None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:04.445579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56db51c-c66f-4833-a472-0b48fee0ef5f None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:04.447559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56db51c-c66f-4833-a472-0b48fee0ef5f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:04.449632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 211/427] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:25:04 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:04.450126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506e641-8d5d-40c6-8bee-ad8570462a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:04.454957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56db51c-c66f-4833-a472-0b48fee0ef5f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:04.458117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-6506e641-8d5d-40c6-8bee-ad8570462a9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:25:04.459551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 217/428] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:04.460505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e641-8d5d-40c6-8bee-ad8570462a9f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:04.559626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56db51c-c66f-4833-a472-0b48fee0ef5f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:04.593683 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e641-8d5d-40c6-8bee-ad8570462a9f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:04.603997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1294c5-3e2b-4d2f-8b31-7f80c68be64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:04.605521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1294c5-3e2b-4d2f-8b31-7f80c68be64d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:04.606031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1294c5-3e2b-4d2f-8b31-7f80c68be64d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:04.606501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1294c5-3e2b-4d2f-8b31-7f80c68be64d None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:04.607914 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1294c5-3e2b-4d2f-8b31-7f80c68be64d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:04.608385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1294c5-3e2b-4d2f-8b31-7f80c68be64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:04.610919 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1294c5-3e2b-4d2f-8b31-7f80c68be64d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:04.626727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 212/429] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:04.626727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1294c5-3e2b-4d2f-8b31-7f80c68be64d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:04.632550 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108a272-36ff-482d-8d88-2cd75f390286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:04.633194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108a272-36ff-482d-8d88-2cd75f390286 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:04.633469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108a272-36ff-482d-8d88-2cd75f390286 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:04.633738 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108a272-36ff-482d-8d88-2cd75f390286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:04.634562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108a272-36ff-482d-8d88-2cd75f390286 None admin] RBAC: Adding query filter params (group.id=fb48d522c45744b3beb13f7907b84aba, role.id=f8641f824b324fa2956c5fc5b764f8ae, scope.project.id=c02cb7cef6b84d34815a0826d3396e94) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:04.634867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108a272-36ff-482d-8d88-2cd75f390286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:04.636573 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108a272-36ff-482d-8d88-2cd75f390286 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:04.642720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 218/430] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Feb 28 10:25:04 2022] GET /identity/v3/role_assignments?group.id=fb48d522c45744b3beb13f7907b84aba&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:04.643657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108a272-36ff-482d-8d88-2cd75f390286 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:04.738071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1294c5-3e2b-4d2f-8b31-7f80c68be64d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:04.747125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108a272-36ff-482d-8d88-2cd75f390286 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:04.775070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edbc8a-6279-48be-afcd-e29990841912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:04.776172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edbc8a-6279-48be-afcd-e29990841912 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:04.776684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edbc8a-6279-48be-afcd-e29990841912 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:04.777189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edbc8a-6279-48be-afcd-e29990841912 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:04.778174 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edbc8a-6279-48be-afcd-e29990841912 None admin] RBAC: Adding query filter params (name=member) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:04.778696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edbc8a-6279-48be-afcd-e29990841912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:04.780384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edbc8a-6279-48be-afcd-e29990841912 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:04.791301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 213/431] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:25:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:04.796882 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edbc8a-6279-48be-afcd-e29990841912 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:04.799408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cbf13-9131-489e-88e4-b3f1acf9e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:04.802637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cbf13-9131-489e-88e4-b3f1acf9e064 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:04.803436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cbf13-9131-489e-88e4-b3f1acf9e064 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:04.803936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cbf13-9131-489e-88e4-b3f1acf9e064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:04.928003 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cbf13-9131-489e-88e4-b3f1acf9e064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:04.929204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cbf13-9131-489e-88e4-b3f1acf9e064 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:04.955598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edbc8a-6279-48be-afcd-e29990841912 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:04.990487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cd465-e7b5-44b6-a819-bce4ada893fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:04.991526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd465-e7b5-44b6-a819-bce4ada893fd None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:04.992009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd465-e7b5-44b6-a819-bce4ada893fd None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:04.992482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd465-e7b5-44b6-a819-bce4ada893fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.031881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 219/432] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:05.040115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cbf13-9131-489e-88e4-b3f1acf9e064 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:05.075706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cd465-e7b5-44b6-a819-bce4ada893fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:05.077415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cd465-e7b5-44b6-a819-bce4ada893fd None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:05.169786 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cbf13-9131-489e-88e4-b3f1acf9e064 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:05.195504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 214/433] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:05.196672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90241737-0ce4-4a3b-90ce-f160d3fd70d2 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.196957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90241737-0ce4-4a3b-90ce-f160d3fd70d2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.197236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90241737-0ce4-4a3b-90ce-f160d3fd70d2 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.203345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 215/434] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:05.203465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db363e-fdb5-4fe3-af47-c1269abda595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:05.204451 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db363e-fdb5-4fe3-af47-c1269abda595 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.204733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db363e-fdb5-4fe3-af47-c1269abda595 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.205004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db363e-fdb5-4fe3-af47-c1269abda595 None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.205586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eae2b-eacb-49a0-8235-7224713bbf3f None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.206084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eae2b-eacb-49a0-8235-7224713bbf3f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.206198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db363e-fdb5-4fe3-af47-c1269abda595 None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:05.206540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eae2b-eacb-49a0-8235-7224713bbf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.207635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db363e-fdb5-4fe3-af47-c1269abda595 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:05.209390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 220/435] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:25:05 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:05.211971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db363e-fdb5-4fe3-af47-c1269abda595 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:05.224673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c11eae2b-eacb-49a0-8235-7224713bbf3f None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:05.225854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c11eae2b-eacb-49a0-8235-7224713bbf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:05.299131 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 216/436] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:05.299131 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11eae2b-eacb-49a0-8235-7224713bbf3f None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:05.319706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db363e-fdb5-4fe3-af47-c1269abda595 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:05.354147 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362befe0-85c8-4e7d-ad73-f45d0d0ba80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:05.355034 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362befe0-85c8-4e7d-ad73-f45d0d0ba80b None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.355320 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362befe0-85c8-4e7d-ad73-f45d0d0ba80b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.355593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362befe0-85c8-4e7d-ad73-f45d0d0ba80b None admin] PATH_INFO: `/v3/projects/c72151b764de430b89f44fcf9d7e9dbb` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.356826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362befe0-85c8-4e7d-ad73-f45d0d0ba80b None admin] RBAC: Authorizing `identity:get_project(project_id=c72151b764de430b89f44fcf9d7e9dbb)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:05.358246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362befe0-85c8-4e7d-ad73-f45d0d0ba80b None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:05.360000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 221/437] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:25:05 2022] GET /identity/v3/projects/c72151b764de430b89f44fcf9d7e9dbb => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:05.360753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362befe0-85c8-4e7d-ad73-f45d0d0ba80b None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:05.407534 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11eae2b-eacb-49a0-8235-7224713bbf3f None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:05.443090 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4561dcd-5e8e-485c-9ec2-bb179d022c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:05.443961 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4561dcd-5e8e-485c-9ec2-bb179d022c53 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.444239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4561dcd-5e8e-485c-9ec2-bb179d022c53 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.444518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4561dcd-5e8e-485c-9ec2-bb179d022c53 None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.445772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4561dcd-5e8e-485c-9ec2-bb179d022c53 None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:05.447193 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4561dcd-5e8e-485c-9ec2-bb179d022c53 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:05.453515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 217/438] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:25:05 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:05.453515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4561dcd-5e8e-485c-9ec2-bb179d022c53 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:05.465927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362befe0-85c8-4e7d-ad73-f45d0d0ba80b None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:05.498875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513422d-8c93-44ec-b631-c068bd2b0838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:05.499700 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513422d-8c93-44ec-b631-c068bd2b0838 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.499975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513422d-8c93-44ec-b631-c068bd2b0838 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.500247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513422d-8c93-44ec-b631-c068bd2b0838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.509877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513422d-8c93-44ec-b631-c068bd2b0838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:05.517318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-1513422d-8c93-44ec-b631-c068bd2b0838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:25:05.518484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 222/439] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:05.519259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513422d-8c93-44ec-b631-c068bd2b0838 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:05.542934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4561dcd-5e8e-485c-9ec2-bb179d022c53 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:05.574552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627507b-6915-444f-9fcc-39a0cd491dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:05.575425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627507b-6915-444f-9fcc-39a0cd491dbe None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.575702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627507b-6915-444f-9fcc-39a0cd491dbe None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.575968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627507b-6915-444f-9fcc-39a0cd491dbe None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.577118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627507b-6915-444f-9fcc-39a0cd491dbe None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:05.578564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627507b-6915-444f-9fcc-39a0cd491dbe None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:05.580178 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 218/440] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:25:05 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:05.581320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fb04b-69a5-4db0-8736-dcf33a11820c None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.581596 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fb04b-69a5-4db0-8736-dcf33a11820c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.581864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fb04b-69a5-4db0-8736-dcf33a11820c None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.586886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 219/441] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:05.586886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fb04b-69a5-4db0-8736-dcf33a11820c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:05.620617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513422d-8c93-44ec-b631-c068bd2b0838 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:05.653139 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b77cc-f9d3-4dab-b66f-1a0ad089a271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:05.653775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b77cc-f9d3-4dab-b66f-1a0ad089a271 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.654053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b77cc-f9d3-4dab-b66f-1a0ad089a271 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.654350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b77cc-f9d3-4dab-b66f-1a0ad089a271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.655202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b77cc-f9d3-4dab-b66f-1a0ad089a271 None admin] RBAC: Adding query filter params (group.id=fb48d522c45744b3beb13f7907b84aba, role.id=79396755fc0842a882775515d6feab13, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:05.655515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b77cc-f9d3-4dab-b66f-1a0ad089a271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:05.656978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b77cc-f9d3-4dab-b66f-1a0ad089a271 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:05.662475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 223/442] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Feb 28 10:25:05 2022] GET /identity/v3/role_assignments?group.id=fb48d522c45744b3beb13f7907b84aba&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=79396755fc0842a882775515d6feab13 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:05.663273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b77cc-f9d3-4dab-b66f-1a0ad089a271 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:05.700880 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fb04b-69a5-4db0-8736-dcf33a11820c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:05.735602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba52a85-0bb7-428c-8435-65b0c8bec193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:05.736284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba52a85-0bb7-428c-8435-65b0c8bec193 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.736562 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba52a85-0bb7-428c-8435-65b0c8bec193 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.736833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba52a85-0bb7-428c-8435-65b0c8bec193 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.737588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba52a85-0bb7-428c-8435-65b0c8bec193 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:05.737892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba52a85-0bb7-428c-8435-65b0c8bec193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:05.739354 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba52a85-0bb7-428c-8435-65b0c8bec193 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:05.753434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 220/443] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:05.753434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1823854-8cba-4652-8b01-252822060126 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.753434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1823854-8cba-4652-8b01-252822060126 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.753434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1823854-8cba-4652-8b01-252822060126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.770395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e1823854-8cba-4652-8b01-252822060126 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:05.771691 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e1823854-8cba-4652-8b01-252822060126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:05.777601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b77cc-f9d3-4dab-b66f-1a0ad089a271 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:05.811225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734dfe8-aede-4efa-a19e-734b93222ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:05.811891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734dfe8-aede-4efa-a19e-734b93222ab1 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.812175 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734dfe8-aede-4efa-a19e-734b93222ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.812453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734dfe8-aede-4efa-a19e-734b93222ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:05.813881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734dfe8-aede-4efa-a19e-734b93222ab1 None admin] RBAC: Adding query filter params (group.id=fb48d522c45744b3beb13f7907b84aba, role.id=f8641f824b324fa2956c5fc5b764f8ae, scope.project.id=c72151b764de430b89f44fcf9d7e9dbb) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:05.814197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734dfe8-aede-4efa-a19e-734b93222ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:05.815706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734dfe8-aede-4efa-a19e-734b93222ab1 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:05.821869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 224/444] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Feb 28 10:25:05 2022] GET /identity/v3/role_assignments?group.id=fb48d522c45744b3beb13f7907b84aba&scope.project.id=c72151b764de430b89f44fcf9d7e9dbb&role.id=f8641f824b324fa2956c5fc5b764f8ae => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:05.822707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734dfe8-aede-4efa-a19e-734b93222ab1 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:05.863070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 221/445] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:05.884087 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1823854-8cba-4652-8b01-252822060126 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:05.964048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734dfe8-aede-4efa-a19e-734b93222ab1 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:05.998199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1823854-8cba-4652-8b01-252822060126 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:05.998622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384baa7-6992-4b80-8105-27e0c6a45dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:05.999311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384baa7-6992-4b80-8105-27e0c6a45dc2 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:05.999594 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384baa7-6992-4b80-8105-27e0c6a45dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:05.999869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384baa7-6992-4b80-8105-27e0c6a45dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:06.039913 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ba09-2b4e-4fb9-a5ff-5205ddaf9956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:06.040718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ba09-2b4e-4fb9-a5ff-5205ddaf9956 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:06.041005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ba09-2b4e-4fb9-a5ff-5205ddaf9956 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:06.041276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ba09-2b4e-4fb9-a5ff-5205ddaf9956 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:06.052942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7ba09-2b4e-4fb9-a5ff-5205ddaf9956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:06.060708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-4cd7ba09-2b4e-4fb9-a5ff-5205ddaf9956 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:25:06.061849 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 222/446] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:06.067566 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ba09-2b4e-4fb9-a5ff-5205ddaf9956 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:06.073010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384baa7-6992-4b80-8105-27e0c6a45dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:06.073010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384baa7-6992-4b80-8105-27e0c6a45dc2 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:06.185561 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ba09-2b4e-4fb9-a5ff-5205ddaf9956 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:06.191110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 225/447] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:06.196477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384baa7-6992-4b80-8105-27e0c6a45dc2 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:06.219827 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1e9c3-382c-4bab-95db-dfccf3f57809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:06.220423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1e9c3-382c-4bab-95db-dfccf3f57809 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:06.220706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1e9c3-382c-4bab-95db-dfccf3f57809 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:06.220977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1e9c3-382c-4bab-95db-dfccf3f57809 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:06.221719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1e9c3-382c-4bab-95db-dfccf3f57809 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:06.222021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1e9c3-382c-4bab-95db-dfccf3f57809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:06.223475 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1e9c3-382c-4bab-95db-dfccf3f57809 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:06.231764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 223/448] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:06.238400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1e9c3-382c-4bab-95db-dfccf3f57809 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:06.313791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384baa7-6992-4b80-8105-27e0c6a45dc2 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:06.338273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1e9c3-382c-4bab-95db-dfccf3f57809 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:06.352213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f20ef-a3cf-4515-9687-95d68170e030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:06.353128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f20ef-a3cf-4515-9687-95d68170e030 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:06.353430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f20ef-a3cf-4515-9687-95d68170e030 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:06.353704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f20ef-a3cf-4515-9687-95d68170e030 None admin] PATH_INFO: `/v3/projects/c02cb7cef6b84d34815a0826d3396e94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:06.354930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f20ef-a3cf-4515-9687-95d68170e030 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cb7cef6b84d34815a0826d3396e94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:06.356385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f20ef-a3cf-4515-9687-95d68170e030 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:06.358067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 226/449] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:25:06 2022] GET /identity/v3/projects/c02cb7cef6b84d34815a0826d3396e94 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:06.364148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f20ef-a3cf-4515-9687-95d68170e030 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:06.376366 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f4b1-1a22-478c-a157-6ae1e45a97f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:06.377014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f4b1-1a22-478c-a157-6ae1e45a97f4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:06.377289 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f4b1-1a22-478c-a157-6ae1e45a97f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:06.377570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f4b1-1a22-478c-a157-6ae1e45a97f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:06.460002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5f4b1-1a22-478c-a157-6ae1e45a97f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:06.461736 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5f4b1-1a22-478c-a157-6ae1e45a97f4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:06.475997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f20ef-a3cf-4515-9687-95d68170e030 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:06.515820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b977265-b3a3-4296-8b52-d7f46f0d074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:06.517164 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b977265-b3a3-4296-8b52-d7f46f0d074c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:06.517443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b977265-b3a3-4296-8b52-d7f46f0d074c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:06.517710 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b977265-b3a3-4296-8b52-d7f46f0d074c None admin] PATH_INFO: `/v3/groups/fb48d522c45744b3beb13f7907b84aba` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:06.518883 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b977265-b3a3-4296-8b52-d7f46f0d074c None admin] RBAC: Authorizing `identity:get_group(group_id=fb48d522c45744b3beb13f7907b84aba)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:06.520365 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b977265-b3a3-4296-8b52-d7f46f0d074c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:06.521950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 227/450] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:25:06 2022] GET /identity/v3/groups/fb48d522c45744b3beb13f7907b84aba => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:06.527686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b977265-b3a3-4296-8b52-d7f46f0d074c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:06.564743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 224/451] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:25:06.570101 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f4b1-1a22-478c-a157-6ae1e45a97f4 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:06.619564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b977265-b3a3-4296-8b52-d7f46f0d074c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:06.651641 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1115b8-e608-4558-899b-2226b5a1906c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:06.652273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1115b8-e608-4558-899b-2226b5a1906c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:06.652551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1115b8-e608-4558-899b-2226b5a1906c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:06.652824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1115b8-e608-4558-899b-2226b5a1906c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:06.653636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1115b8-e608-4558-899b-2226b5a1906c None admin] RBAC: Adding query filter params (group.id=fb48d522c45744b3beb13f7907b84aba, role.id=79396755fc0842a882775515d6feab13, scope.project.id=c02cb7cef6b84d34815a0826d3396e94) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:06.654194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1115b8-e608-4558-899b-2226b5a1906c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:06.655369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1115b8-e608-4558-899b-2226b5a1906c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:06.660743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f4b1-1a22-478c-a157-6ae1e45a97f4 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:06.661031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 228/452] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Feb 28 10:25:06 2022] GET /identity/v3/role_assignments?group.id=fb48d522c45744b3beb13f7907b84aba&scope.project.id=c02cb7cef6b84d34815a0826d3396e94&role.id=79396755fc0842a882775515d6feab13 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:06.696379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1f7f6-1215-4b6a-b7bd-52389449af53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:06.697244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f7f6-1215-4b6a-b7bd-52389449af53 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:06.697520 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f7f6-1215-4b6a-b7bd-52389449af53 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:06.697789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f7f6-1215-4b6a-b7bd-52389449af53 None admin] PATH_INFO: `/v3/projects/df99af6079f04b40ae2fb2b304eafd0e` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:06.699062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1f7f6-1215-4b6a-b7bd-52389449af53 None admin] RBAC: Authorizing `identity:get_project(project_id=df99af6079f04b40ae2fb2b304eafd0e)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:06.700524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1f7f6-1215-4b6a-b7bd-52389449af53 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:06.702264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 225/453] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:25:06 2022] GET /identity/v3/projects/df99af6079f04b40ae2fb2b304eafd0e => generated 344 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:06.707891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1115b8-e608-4558-899b-2226b5a1906c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:06.808142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1115b8-e608-4558-899b-2226b5a1906c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:06.842066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39f7a8-7fb0-488d-b525-631782e002bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:06.842931 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f7a8-7fb0-488d-b525-631782e002bb None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:06.843206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f7a8-7fb0-488d-b525-631782e002bb None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:06.843474 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f7a8-7fb0-488d-b525-631782e002bb None admin] PATH_INFO: `/v3/groups/e1afef9b0936409a94f2c79fbc8dcc29` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:06.844679 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39f7a8-7fb0-488d-b525-631782e002bb None admin] RBAC: Authorizing `identity:get_group(group_id=e1afef9b0936409a94f2c79fbc8dcc29)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:06.846098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39f7a8-7fb0-488d-b525-631782e002bb None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:06.848028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 229/454] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Feb 28 10:25:06 2022] GET /identity/v3/groups/e1afef9b0936409a94f2c79fbc8dcc29 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:06.853526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1f7f6-1215-4b6a-b7bd-52389449af53 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:06.952778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1f7f6-1215-4b6a-b7bd-52389449af53 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:06.987112 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e0a6c-f7c1-45a3-86b4-17e1b5289f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:06.987762 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e0a6c-f7c1-45a3-86b4-17e1b5289f19 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:06.988038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e0a6c-f7c1-45a3-86b4-17e1b5289f19 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:06.988306 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e0a6c-f7c1-45a3-86b4-17e1b5289f19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:06.989118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e0a6c-f7c1-45a3-86b4-17e1b5289f19 None admin] RBAC: Adding query filter params (group.id=e1afef9b0936409a94f2c79fbc8dcc29, role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=df99af6079f04b40ae2fb2b304eafd0e) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:06.989422 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e0a6c-f7c1-45a3-86b4-17e1b5289f19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:06.991428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e0a6c-f7c1-45a3-86b4-17e1b5289f19 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:06.996552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 226/455] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Feb 28 10:25:06 2022] GET /identity/v3/role_assignments?group.id=e1afef9b0936409a94f2c79fbc8dcc29&scope.project.id=df99af6079f04b40ae2fb2b304eafd0e&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:09.799478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6997c-bc7f-4788-8ff3-5c55e4a40e17 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:09.799997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6997c-bc7f-4788-8ff3-5c55e4a40e17 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:09.799997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6997c-bc7f-4788-8ff3-5c55e4a40e17 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:09.802021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 230/456] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:09.807617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34740b-7610-4d72-9941-174e872f0485 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:09.808032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34740b-7610-4d72-9941-174e872f0485 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:09.808198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34740b-7610-4d72-9941-174e872f0485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:09.835873 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-3b34740b-7610-4d72-9941-174e872f0485 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:09.837058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3b34740b-7610-4d72-9941-174e872f0485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:09.932539 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 227/457] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:25:09.980040 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6997c-bc7f-4788-8ff3-5c55e4a40e17 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:10.108559 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6997c-bc7f-4788-8ff3-5c55e4a40e17 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:10.124079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ef9ea-45ee-4cd0-a71c-ffbabcfedab4 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.124702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ef9ea-45ee-4cd0-a71c-ffbabcfedab4 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.125179 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ef9ea-45ee-4cd0-a71c-ffbabcfedab4 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.128011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 228/458] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:10.133425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13dd8-fdff-41c6-8ede-bd1e14cab8bc None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.133983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13dd8-fdff-41c6-8ede-bd1e14cab8bc None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.134480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13dd8-fdff-41c6-8ede-bd1e14cab8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.153289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879dca8-3c66-4d38-bc7e-06368bd97b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:10.154084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879dca8-3c66-4d38-bc7e-06368bd97b74 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.154364 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879dca8-3c66-4d38-bc7e-06368bd97b74 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.154631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879dca8-3c66-4d38-bc7e-06368bd97b74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.170559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-91e13dd8-fdff-41c6-8ede-bd1e14cab8bc None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:10.171799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-91e13dd8-fdff-41c6-8ede-bd1e14cab8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:10.176644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879dca8-3c66-4d38-bc7e-06368bd97b74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:10.179645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879dca8-3c66-4d38-bc7e-06368bd97b74 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:10.207747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-f879dca8-3c66-4d38-bc7e-06368bd97b74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:10.216619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 231/459] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:10.223861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879dca8-3c66-4d38-bc7e-06368bd97b74 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:10.316236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 229/460] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:25:10.348966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e13dd8-fdff-41c6-8ede-bd1e14cab8bc None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:10.357380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879dca8-3c66-4d38-bc7e-06368bd97b74 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:10.397597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712a1ff-f5bf-42c9-83b9-0c811f95b954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:10.398252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712a1ff-f5bf-42c9-83b9-0c811f95b954 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.398529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712a1ff-f5bf-42c9-83b9-0c811f95b954 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.398799 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712a1ff-f5bf-42c9-83b9-0c811f95b954 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.399551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712a1ff-f5bf-42c9-83b9-0c811f95b954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:10.399852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712a1ff-f5bf-42c9-83b9-0c811f95b954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:10.401229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712a1ff-f5bf-42c9-83b9-0c811f95b954 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:10.429233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 232/461] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:10.434486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712a1ff-f5bf-42c9-83b9-0c811f95b954 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:10.499501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e13dd8-fdff-41c6-8ede-bd1e14cab8bc None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:10.534830 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234fa62-a4fa-4e18-ad7e-eb8933da5fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:10.536121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234fa62-a4fa-4e18-ad7e-eb8933da5fc8 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.536643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234fa62-a4fa-4e18-ad7e-eb8933da5fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.537115 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234fa62-a4fa-4e18-ad7e-eb8933da5fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.548666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234fa62-a4fa-4e18-ad7e-eb8933da5fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:10.550533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234fa62-a4fa-4e18-ad7e-eb8933da5fc8 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:10.551164 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712a1ff-f5bf-42c9-83b9-0c811f95b954 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:10.569586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-3234fa62-a4fa-4e18-ad7e-eb8933da5fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:10.571526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 230/462] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:10.573090 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c62f3-add3-4b1e-a53d-3a781939abd6 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.573622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c62f3-add3-4b1e-a53d-3a781939abd6 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.574116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c62f3-add3-4b1e-a53d-3a781939abd6 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.576684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 231/463] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:10.578078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4a80-985a-45c6-ae1a-f8a3b95fc2e7 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.578671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4a80-985a-45c6-ae1a-f8a3b95fc2e7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.579183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4a80-985a-45c6-ae1a-f8a3b95fc2e7 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.581201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 232/464] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:10.582215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc4a80-985a-45c6-ae1a-f8a3b95fc2e7 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:10.587677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbb683-ffab-4369-9542-0442cb3bab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:10.588349 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbb683-ffab-4369-9542-0442cb3bab07 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.588630 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbb683-ffab-4369-9542-0442cb3bab07 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.588900 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbb683-ffab-4369-9542-0442cb3bab07 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.589600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbb683-ffab-4369-9542-0442cb3bab07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:10.591328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbb683-ffab-4369-9542-0442cb3bab07 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:10.623004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 233/465] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:25:10 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:25:10.623004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070440-e838-4b52-929b-ce0ae9755f44 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.623004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070440-e838-4b52-929b-ce0ae9755f44 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.623004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070440-e838-4b52-929b-ce0ae9755f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.644408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-33070440-e838-4b52-929b-ce0ae9755f44 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:10.645832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-33070440-e838-4b52-929b-ce0ae9755f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:10.698754 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc4a80-985a-45c6-ae1a-f8a3b95fc2e7 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:10.721621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 234/466] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:10.723064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ff06b-d098-4d6d-886f-0a60d0d7c5bc None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.723404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ff06b-d098-4d6d-886f-0a60d0d7c5bc None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.723978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ff06b-d098-4d6d-886f-0a60d0d7c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.735906 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89438641-aed1-4b4b-8641-c2860391506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:10.736579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89438641-aed1-4b4b-8641-c2860391506d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.736855 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89438641-aed1-4b4b-8641-c2860391506d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.737125 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89438641-aed1-4b4b-8641-c2860391506d None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.737899 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89438641-aed1-4b4b-8641-c2860391506d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:10.738205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89438641-aed1-4b4b-8641-c2860391506d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:10.739616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89438641-aed1-4b4b-8641-c2860391506d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:10.741945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f94ff06b-d098-4d6d-886f-0a60d0d7c5bc None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:10.743303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f94ff06b-d098-4d6d-886f-0a60d0d7c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:10.752810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 233/467] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:10.757883 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89438641-aed1-4b4b-8641-c2860391506d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:10.829683 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 235/468] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:10.834977 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ff06b-d098-4d6d-886f-0a60d0d7c5bc None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:10.875318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89438641-aed1-4b4b-8641-c2860391506d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:10.917240 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df6fe8-3071-4a34-a308-b129fcfa9f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:10.917910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df6fe8-3071-4a34-a308-b129fcfa9f63 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.918186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df6fe8-3071-4a34-a308-b129fcfa9f63 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.918453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df6fe8-3071-4a34-a308-b129fcfa9f63 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.919192 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df6fe8-3071-4a34-a308-b129fcfa9f63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:10.920605 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df6fe8-3071-4a34-a308-b129fcfa9f63 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:10.940320 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ff06b-d098-4d6d-886f-0a60d0d7c5bc None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:10.950723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 234/469] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:25:10 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:25:10.951693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df6fe8-3071-4a34-a308-b129fcfa9f63 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:10.988509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318be31d-1da5-473d-87aa-896e6782d4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:10.990279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318be31d-1da5-473d-87aa-896e6782d4c3 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.991100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318be31d-1da5-473d-87aa-896e6782d4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.991597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318be31d-1da5-473d-87aa-896e6782d4c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:11.008660 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318be31d-1da5-473d-87aa-896e6782d4c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:11.011546 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318be31d-1da5-473d-87aa-896e6782d4c3 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:11.035418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-318be31d-1da5-473d-87aa-896e6782d4c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:11.038439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 236/470] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:11.040164 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c48b3b-22bb-4fca-8b62-9a0fe0038fb1 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:11.040655 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c48b3b-22bb-4fca-8b62-9a0fe0038fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:11.041128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c48b3b-22bb-4fca-8b62-9a0fe0038fb1 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:11.043928 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 237/471] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:11.044952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c48b3b-22bb-4fca-8b62-9a0fe0038fb1 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:11.088480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df6fe8-3071-4a34-a308-b129fcfa9f63 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:11.128624 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01324e6-1c64-40b5-ac59-6fc2d1cea6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:11.129384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01324e6-1c64-40b5-ac59-6fc2d1cea6d2 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:11.129742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01324e6-1c64-40b5-ac59-6fc2d1cea6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:11.130084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01324e6-1c64-40b5-ac59-6fc2d1cea6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:11.144172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01324e6-1c64-40b5-ac59-6fc2d1cea6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:11.145720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01324e6-1c64-40b5-ac59-6fc2d1cea6d2 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:11.166175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-a01324e6-1c64-40b5-ac59-6fc2d1cea6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:11.167623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 235/472] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:11.169056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa5247-b809-4855-b2a0-65fafd825060 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:11.169432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa5247-b809-4855-b2a0-65fafd825060 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:11.169709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa5247-b809-4855-b2a0-65fafd825060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:11.176691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c48b3b-22bb-4fca-8b62-9a0fe0038fb1 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:11.194300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-1aaa5247-b809-4855-b2a0-65fafd825060 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:11.195878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-1aaa5247-b809-4855-b2a0-65fafd825060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:11.211867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a130e-5f70-4411-a727-02b58cd426f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:11.212524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a130e-5f70-4411-a727-02b58cd426f6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:11.212802 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a130e-5f70-4411-a727-02b58cd426f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:11.213085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a130e-5f70-4411-a727-02b58cd426f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:11.213783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a130e-5f70-4411-a727-02b58cd426f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:11.214082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a130e-5f70-4411-a727-02b58cd426f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:11.215569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a130e-5f70-4411-a727-02b58cd426f6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:11.226843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 238/473] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:11.227981 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a130e-5f70-4411-a727-02b58cd426f6 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:11.275566 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 236/474] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:11.276693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa5247-b809-4855-b2a0-65fafd825060 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:11.342210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a130e-5f70-4411-a727-02b58cd426f6 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:11.375820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46de0a-169c-46a8-9d5a-ad531f0cee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:11.376312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46de0a-169c-46a8-9d5a-ad531f0cee9c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:11.376588 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46de0a-169c-46a8-9d5a-ad531f0cee9c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:11.376858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46de0a-169c-46a8-9d5a-ad531f0cee9c None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:11.377626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46de0a-169c-46a8-9d5a-ad531f0cee9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:11.378019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46de0a-169c-46a8-9d5a-ad531f0cee9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:11.379430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46de0a-169c-46a8-9d5a-ad531f0cee9c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:11.392283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 239/475] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:11.393095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46de0a-169c-46a8-9d5a-ad531f0cee9c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:11.416249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa5247-b809-4855-b2a0-65fafd825060 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:11.462933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3718a-946c-4ccc-be02-6c7bf2afca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:11.464157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3718a-946c-4ccc-be02-6c7bf2afca10 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:11.465064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3718a-946c-4ccc-be02-6c7bf2afca10 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:11.465512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3718a-946c-4ccc-be02-6c7bf2afca10 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:11.466636 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3718a-946c-4ccc-be02-6c7bf2afca10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:11.469729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3718a-946c-4ccc-be02-6c7bf2afca10 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:11.493727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 237/476] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:25:11 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:25:11.494841 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3718a-946c-4ccc-be02-6c7bf2afca10 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:11.549013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46de0a-169c-46a8-9d5a-ad531f0cee9c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:11.674674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3718a-946c-4ccc-be02-6c7bf2afca10 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:11.675092 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68a47b-e2b1-4562-8422-68d48751fa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:11.675781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68a47b-e2b1-4562-8422-68d48751fa43 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:11.676057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68a47b-e2b1-4562-8422-68d48751fa43 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:11.676327 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68a47b-e2b1-4562-8422-68d48751fa43 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:11.677082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68a47b-e2b1-4562-8422-68d48751fa43 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:11.678464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68a47b-e2b1-4562-8422-68d48751fa43 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:11.702941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.sql.core [None req-5a68a47b-e2b1-4562-8422-68d48751fa43 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 28 10:25:11.702941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 28 10:25:11.702941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [parameters: {'id': '74eec79e8fac4c0886fc3426e97fa766', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 28 10:25:11.702941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79326) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 10:25:11.713825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47930654-0cca-47a2-a834-31d2935bc2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:11.714876 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930654-0cca-47a2-a834-31d2935bc2c6 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:11.715406 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930654-0cca-47a2-a834-31d2935bc2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:11.715922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930654-0cca-47a2-a834-31d2935bc2c6 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:11.716905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47930654-0cca-47a2-a834-31d2935bc2c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:11.718593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47930654-0cca-47a2-a834-31d2935bc2c6 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:11.739499 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-5a68a47b-e2b1-4562-8422-68d48751fa43 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 28 10:25:11.741345 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 240/477] 10.222.0.44 () {60 vars in 1131 bytes} [Mon Feb 28 10:25:11 2022] POST /identity/v3/roles => generated 144 bytes in 348 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:11.752220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68a47b-e2b1-4562-8422-68d48751fa43 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:11.756345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 238/478] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:25:11 2022] POST /identity/v3/users => generated 249 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:25:11.904314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68a47b-e2b1-4562-8422-68d48751fa43 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:11.944927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3b244-a164-4846-852a-d28155fa915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:11.946162 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b244-a164-4846-852a-d28155fa915b None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:11.946667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b244-a164-4846-852a-d28155fa915b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:11.947191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b244-a164-4846-852a-d28155fa915b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:11.959896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3b244-a164-4846-852a-d28155fa915b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:11.968100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-bea3b244-a164-4846-852a-d28155fa915b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:25:11.970119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 241/479] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:11.977658 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47930654-0cca-47a2-a834-31d2935bc2c6 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:12.116540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47930654-0cca-47a2-a834-31d2935bc2c6 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:12.167143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e0ba6-6a2c-4e20-86da-79c04e2fba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:12.168337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e0ba6-6a2c-4e20-86da-79c04e2fba53 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:12.174951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e0ba6-6a2c-4e20-86da-79c04e2fba53 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:12.174951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e0ba6-6a2c-4e20-86da-79c04e2fba53 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:12.174951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e0ba6-6a2c-4e20-86da-79c04e2fba53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:12.174951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e0ba6-6a2c-4e20-86da-79c04e2fba53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:12.176176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e0ba6-6a2c-4e20-86da-79c04e2fba53 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:12.188505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 239/480] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:13.389003 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cbe7-7a1d-4a0e-87fc-038ea3e6e1ea None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:13.389547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cbe7-7a1d-4a0e-87fc-038ea3e6e1ea None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:13.389547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cbe7-7a1d-4a0e-87fc-038ea3e6e1ea None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:13.392243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 242/481] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:13.398049 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2793a-ed62-40ac-aecd-26bf42b4db18 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:13.398471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2793a-ed62-40ac-aecd-26bf42b4db18 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:13.398659 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2793a-ed62-40ac-aecd-26bf42b4db18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:13.420362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-7df2793a-ed62-40ac-aecd-26bf42b4db18 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:13.421524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7df2793a-ed62-40ac-aecd-26bf42b4db18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:13.505365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 240/482] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:13.547176 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9cbe7-7a1d-4a0e-87fc-038ea3e6e1ea None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:13.676622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9cbe7-7a1d-4a0e-87fc-038ea3e6e1ea None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:13.714548 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa1d90-94b1-448e-bfed-84782ece6246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:13.715360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa1d90-94b1-448e-bfed-84782ece6246 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:13.715634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa1d90-94b1-448e-bfed-84782ece6246 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:13.715903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa1d90-94b1-448e-bfed-84782ece6246 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:13.729856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa1d90-94b1-448e-bfed-84782ece6246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:13.736829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-baaa1d90-94b1-448e-bfed-84782ece6246 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:13.738029 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 243/483] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:13.744467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2793a-ed62-40ac-aecd-26bf42b4db18 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:13.789476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda9943-3319-401e-8039-82c01821d271 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:13.789779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda9943-3319-401e-8039-82c01821d271 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:13.790023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda9943-3319-401e-8039-82c01821d271 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:13.792041 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 244/484] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:25:13.796797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad577cb-e63b-4cfe-bd10-30ac62c94880 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:13.797162 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad577cb-e63b-4cfe-bd10-30ac62c94880 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:13.797439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad577cb-e63b-4cfe-bd10-30ac62c94880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:13.825812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-fad577cb-e63b-4cfe-bd10-30ac62c94880 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:13.827009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fad577cb-e63b-4cfe-bd10-30ac62c94880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:13.925014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2793a-ed62-40ac-aecd-26bf42b4db18 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:13.939672 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 245/485] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:25:13.969921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ee76e-b20d-4fe3-9308-d7360e33d933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:13.970630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ee76e-b20d-4fe3-9308-d7360e33d933 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:13.970920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ee76e-b20d-4fe3-9308-d7360e33d933 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:13.971331 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ee76e-b20d-4fe3-9308-d7360e33d933 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:13.971939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad577cb-e63b-4cfe-bd10-30ac62c94880 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:13.972139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ee76e-b20d-4fe3-9308-d7360e33d933 None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:13.972374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ee76e-b20d-4fe3-9308-d7360e33d933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:13.973749 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ee76e-b20d-4fe3-9308-d7360e33d933 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:13.987424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 241/486] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:13.995855 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ee76e-b20d-4fe3-9308-d7360e33d933 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:14.102084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ee76e-b20d-4fe3-9308-d7360e33d933 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:14.150025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad577cb-e63b-4cfe-bd10-30ac62c94880 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:14.167591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b04ef-363e-4393-923b-cb976a359b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:14.168388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b04ef-363e-4393-923b-cb976a359b3e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.168662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b04ef-363e-4393-923b-cb976a359b3e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.168931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b04ef-363e-4393-923b-cb976a359b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.196670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b04ef-363e-4393-923b-cb976a359b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:14.198078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b04ef-363e-4393-923b-cb976a359b3e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:14.225182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-001b04ef-363e-4393-923b-cb976a359b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:14.226592 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 242/487] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:14.234593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45e0e1-0980-4cbd-ad31-96e37792fc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:14.235416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e0e1-0980-4cbd-ad31-96e37792fc6a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.235694 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e0e1-0980-4cbd-ad31-96e37792fc6a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.235971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e0e1-0980-4cbd-ad31-96e37792fc6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.236567 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b04ef-363e-4393-923b-cb976a359b3e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:14.259895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45e0e1-0980-4cbd-ad31-96e37792fc6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:14.275811 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-eb45e0e1-0980-4cbd-ad31-96e37792fc6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:14.277338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 246/488] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:14.282678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45e0e1-0980-4cbd-ad31-96e37792fc6a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:14.340996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b04ef-363e-4393-923b-cb976a359b3e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:14.375815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b13067-47cc-4d1b-9479-27d3d35293bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:14.376837 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b13067-47cc-4d1b-9479-27d3d35293bb None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.377319 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b13067-47cc-4d1b-9479-27d3d35293bb None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.377791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b13067-47cc-4d1b-9479-27d3d35293bb None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.378697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b13067-47cc-4d1b-9479-27d3d35293bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:14.379251 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b13067-47cc-4d1b-9479-27d3d35293bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:14.380907 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b13067-47cc-4d1b-9479-27d3d35293bb None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:14.398020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 243/489] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:14.399639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b13067-47cc-4d1b-9479-27d3d35293bb None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:14.466981 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45e0e1-0980-4cbd-ad31-96e37792fc6a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:14.505884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b13067-47cc-4d1b-9479-27d3d35293bb None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:14.519596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73da739-890e-4202-a5de-285eebafdf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:14.520270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73da739-890e-4202-a5de-285eebafdf71 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.520553 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73da739-890e-4202-a5de-285eebafdf71 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.520823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73da739-890e-4202-a5de-285eebafdf71 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.521577 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73da739-890e-4202-a5de-285eebafdf71 None admin] RBAC: Adding query filter params (name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:14.521884 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73da739-890e-4202-a5de-285eebafdf71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:14.523289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73da739-890e-4202-a5de-285eebafdf71 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:14.541523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 247/490] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:14.543922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e4d4b-b903-42fc-8046-1d874c7ce0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:14.544966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e4d4b-b903-42fc-8046-1d874c7ce0f9 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.545445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e4d4b-b903-42fc-8046-1d874c7ce0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.545996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e4d4b-b903-42fc-8046-1d874c7ce0f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.546822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73da739-890e-4202-a5de-285eebafdf71 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:14.554522 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e4d4b-b903-42fc-8046-1d874c7ce0f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:14.556407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e4d4b-b903-42fc-8046-1d874c7ce0f9 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:14.571268 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-845e4d4b-b903-42fc-8046-1d874c7ce0f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:25:14.577378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 244/491] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Feb 28 10:25:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:14.578941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e4d4b-b903-42fc-8046-1d874c7ce0f9 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:14.677928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e4d4b-b903-42fc-8046-1d874c7ce0f9 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:14.692950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73da739-890e-4202-a5de-285eebafdf71 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:14.712253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f627c28-79c5-414f-b638-7704ecda56ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:14.712924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f627c28-79c5-414f-b638-7704ecda56ba None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.713206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f627c28-79c5-414f-b638-7704ecda56ba None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.713478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f627c28-79c5-414f-b638-7704ecda56ba None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.714301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f627c28-79c5-414f-b638-7704ecda56ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:14.714607 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f627c28-79c5-414f-b638-7704ecda56ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:14.716120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f627c28-79c5-414f-b638-7704ecda56ba None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:14.734570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f4934-420e-4732-adda-030f219d2c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:14.735701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f4934-420e-4732-adda-030f219d2c2b None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.736188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f4934-420e-4732-adda-030f219d2c2b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.736661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f4934-420e-4732-adda-030f219d2c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.747827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f4934-420e-4732-adda-030f219d2c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:14.749595 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f4934-420e-4732-adda-030f219d2c2b None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:14.759457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 245/492] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Feb 28 10:25:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:14.761131 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e252ba-b181-4854-9c56-3d6444f693e5 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.761417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e252ba-b181-4854-9c56-3d6444f693e5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.761693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e252ba-b181-4854-9c56-3d6444f693e5 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.763831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 246/493] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:14.764586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e252ba-b181-4854-9c56-3d6444f693e5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:14.769124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-7a6f4934-420e-4732-adda-030f219d2c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:14.770793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 248/494] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:14.776462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4175aa4-d7bb-4e01-b469-d256ef7879ee None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.777108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4175aa4-d7bb-4e01-b469-d256ef7879ee None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.777600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4175aa4-d7bb-4e01-b469-d256ef7879ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.795879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e4175aa4-d7bb-4e01-b469-d256ef7879ee None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:14.797096 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e4175aa4-d7bb-4e01-b469-d256ef7879ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:14.870930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 249/495] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:14.870930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4175aa4-d7bb-4e01-b469-d256ef7879ee None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:14.882238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e252ba-b181-4854-9c56-3d6444f693e5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:14.916797 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d01911-e6a2-448c-954f-1cb59a68c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:14.917442 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d01911-e6a2-448c-954f-1cb59a68c229 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.917717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d01911-e6a2-448c-954f-1cb59a68c229 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.917988 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d01911-e6a2-448c-954f-1cb59a68c229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.972279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4175aa4-d7bb-4e01-b469-d256ef7879ee None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:14.987136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d01911-e6a2-448c-954f-1cb59a68c229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:14.988572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d01911-e6a2-448c-954f-1cb59a68c229 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:15.009541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b059490-ea0d-42a3-8c9f-03e1df33133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.010462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b059490-ea0d-42a3-8c9f-03e1df33133c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.010739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b059490-ea0d-42a3-8c9f-03e1df33133c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.011050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b059490-ea0d-42a3-8c9f-03e1df33133c None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.011786 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b059490-ea0d-42a3-8c9f-03e1df33133c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:15.012064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b059490-ea0d-42a3-8c9f-03e1df33133c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:15.013416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b059490-ea0d-42a3-8c9f-03e1df33133c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:15.024506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 250/496] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:15.025818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa63aa-9737-453b-9f72-8c60adb4bc31 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.026107 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa63aa-9737-453b-9f72-8c60adb4bc31 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.026379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa63aa-9737-453b-9f72-8c60adb4bc31 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.028269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 251/497] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:15.032180 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa63aa-9737-453b-9f72-8c60adb4bc31 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:15.108094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 247/498] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:15.108272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d01911-e6a2-448c-954f-1cb59a68c229 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:15.135676 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa63aa-9737-453b-9f72-8c60adb4bc31 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:15.169154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084ecc3-73f3-4e77-b3de-cef93cd1dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.170230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084ecc3-73f3-4e77-b3de-cef93cd1dd3e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.170705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084ecc3-73f3-4e77-b3de-cef93cd1dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.171117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084ecc3-73f3-4e77-b3de-cef93cd1dd3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.182092 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084ecc3-73f3-4e77-b3de-cef93cd1dd3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:15.189731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-9084ecc3-73f3-4e77-b3de-cef93cd1dd3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:15.195918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 252/499] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:15.195918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800aae1-e3a7-4365-be3d-26a5545c3629 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.195918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800aae1-e3a7-4365-be3d-26a5545c3629 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.195918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800aae1-e3a7-4365-be3d-26a5545c3629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.208350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d01911-e6a2-448c-954f-1cb59a68c229 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:15.210262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2800aae1-e3a7-4365-be3d-26a5545c3629 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:15.211466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2800aae1-e3a7-4365-be3d-26a5545c3629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:15.242334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0089553-2ac3-4e56-aa02-f2cbe33bf1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.243077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089553-2ac3-4e56-aa02-f2cbe33bf1c6 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.243352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089553-2ac3-4e56-aa02-f2cbe33bf1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.243623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089553-2ac3-4e56-aa02-f2cbe33bf1c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.250381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0089553-2ac3-4e56-aa02-f2cbe33bf1c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:15.251824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0089553-2ac3-4e56-aa02-f2cbe33bf1c6 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:15.264971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e0089553-2ac3-4e56-aa02-f2cbe33bf1c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 10:25:15.266142 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 248/500] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:15.266888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0089553-2ac3-4e56-aa02-f2cbe33bf1c6 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:15.276388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 253/501] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:15.277444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800aae1-e3a7-4365-be3d-26a5545c3629 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:15.360031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0089553-2ac3-4e56-aa02-f2cbe33bf1c6 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:15.375923 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800aae1-e3a7-4365-be3d-26a5545c3629 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:15.392402 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda494ae-bdec-4d7e-9b84-b492f7d4c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.393170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda494ae-bdec-4d7e-9b84-b492f7d4c6be None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.393440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda494ae-bdec-4d7e-9b84-b492f7d4c6be None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.393717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda494ae-bdec-4d7e-9b84-b492f7d4c6be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.403007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda494ae-bdec-4d7e-9b84-b492f7d4c6be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:15.404457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda494ae-bdec-4d7e-9b84-b492f7d4c6be None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:15.408069 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b816ed4-6777-476c-9d7c-96e8f51344bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.408717 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b816ed4-6777-476c-9d7c-96e8f51344bd None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.408994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b816ed4-6777-476c-9d7c-96e8f51344bd None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.409267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b816ed4-6777-476c-9d7c-96e8f51344bd None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.410000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b816ed4-6777-476c-9d7c-96e8f51344bd None admin] RBAC: Adding query filter params (name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:15.410307 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b816ed4-6777-476c-9d7c-96e8f51344bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:15.411687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b816ed4-6777-476c-9d7c-96e8f51344bd None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:15.419188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 254/502] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:15.420374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b52ec-2c47-4f34-baa1-3c47ba2fb46b None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.420669 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b52ec-2c47-4f34-baa1-3c47ba2fb46b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.420940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b52ec-2c47-4f34-baa1-3c47ba2fb46b None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.421383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-dda494ae-bdec-4d7e-9b84-b492f7d4c6be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:15.427704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 255/503] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:15.427704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b52ec-2c47-4f34-baa1-3c47ba2fb46b None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:15.427922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 249/504] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:15.427922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda494ae-bdec-4d7e-9b84-b492f7d4c6be None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:15.519539 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda494ae-bdec-4d7e-9b84-b492f7d4c6be None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:15.522166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b52ec-2c47-4f34-baa1-3c47ba2fb46b None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:15.551056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d34b0-814a-43eb-9071-0ac0450d4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.551825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d34b0-814a-43eb-9071-0ac0450d4804 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.552103 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d34b0-814a-43eb-9071-0ac0450d4804 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.552369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d34b0-814a-43eb-9071-0ac0450d4804 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.555024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41fcd9-ca53-4206-b304-d85ca4442e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.555666 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41fcd9-ca53-4206-b304-d85ca4442e91 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.555940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41fcd9-ca53-4206-b304-d85ca4442e91 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.556208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41fcd9-ca53-4206-b304-d85ca4442e91 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.557019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41fcd9-ca53-4206-b304-d85ca4442e91 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:15.557319 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41fcd9-ca53-4206-b304-d85ca4442e91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:15.558723 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41fcd9-ca53-4206-b304-d85ca4442e91 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:15.561912 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d34b0-814a-43eb-9071-0ac0450d4804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:15.569338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-962d34b0-814a-43eb-9071-0ac0450d4804 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:15.570686 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 250/505] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:15.571267 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d34b0-814a-43eb-9071-0ac0450d4804 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:15.594986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 256/506] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Feb 28 10:25:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:15.596298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae325dd-4231-47eb-a43a-0305240e16c9 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.596582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae325dd-4231-47eb-a43a-0305240e16c9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.596850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae325dd-4231-47eb-a43a-0305240e16c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.615516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-5ae325dd-4231-47eb-a43a-0305240e16c9 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:15.616708 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5ae325dd-4231-47eb-a43a-0305240e16c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:15.666676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d34b0-814a-43eb-9071-0ac0450d4804 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:15.678951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 257/507] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:15.679700 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae325dd-4231-47eb-a43a-0305240e16c9 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:15.700210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a0d4a-f818-4e80-a6b1-e4bcf5b3f0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.701744 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a0d4a-f818-4e80-a6b1-e4bcf5b3f0df None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.701744 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a0d4a-f818-4e80-a6b1-e4bcf5b3f0df None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.701744 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a0d4a-f818-4e80-a6b1-e4bcf5b3f0df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.711868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a0d4a-f818-4e80-a6b1-e4bcf5b3f0df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:15.713311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a0d4a-f818-4e80-a6b1-e4bcf5b3f0df None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:15.729998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-495a0d4a-f818-4e80-a6b1-e4bcf5b3f0df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:15.731340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 251/508] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:15.731942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a0d4a-f818-4e80-a6b1-e4bcf5b3f0df None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:15.774237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae325dd-4231-47eb-a43a-0305240e16c9 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:15.806520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee8f5a-aa9e-406a-92cc-2b8fe0b4394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.807198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee8f5a-aa9e-406a-92cc-2b8fe0b4394d None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.807483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee8f5a-aa9e-406a-92cc-2b8fe0b4394d None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.807758 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee8f5a-aa9e-406a-92cc-2b8fe0b4394d None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.808465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee8f5a-aa9e-406a-92cc-2b8fe0b4394d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:15.808770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee8f5a-aa9e-406a-92cc-2b8fe0b4394d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:15.810145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee8f5a-aa9e-406a-92cc-2b8fe0b4394d None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:15.820725 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 258/509] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:15.821493 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee8f5a-aa9e-406a-92cc-2b8fe0b4394d None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:15.824451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a0d4a-f818-4e80-a6b1-e4bcf5b3f0df None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:15.855931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a09e5f-e43a-4426-8fa5-1ede9bf4b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.856576 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a09e5f-e43a-4426-8fa5-1ede9bf4b9c3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.856851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a09e5f-e43a-4426-8fa5-1ede9bf4b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.857117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a09e5f-e43a-4426-8fa5-1ede9bf4b9c3 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.857840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a09e5f-e43a-4426-8fa5-1ede9bf4b9c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:15.858137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a09e5f-e43a-4426-8fa5-1ede9bf4b9c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:15.859585 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a09e5f-e43a-4426-8fa5-1ede9bf4b9c3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:15.867066 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 252/510] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:15.867828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a09e5f-e43a-4426-8fa5-1ede9bf4b9c3 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:15.916472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee8f5a-aa9e-406a-92cc-2b8fe0b4394d None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:15.947886 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9202277-d0ea-4a0d-8081-51a8975972ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.948524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9202277-d0ea-4a0d-8081-51a8975972ba None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.948804 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9202277-d0ea-4a0d-8081-51a8975972ba None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.949077 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9202277-d0ea-4a0d-8081-51a8975972ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:15.959493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a09e5f-e43a-4426-8fa5-1ede9bf4b9c3 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:15.991735 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38e89a-7e04-4bb2-9d31-975bed1d7c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:15.992495 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38e89a-7e04-4bb2-9d31-975bed1d7c4c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:15.992769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38e89a-7e04-4bb2-9d31-975bed1d7c4c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:15.993035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38e89a-7e04-4bb2-9d31-975bed1d7c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.003238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38e89a-7e04-4bb2-9d31-975bed1d7c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.004727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38e89a-7e04-4bb2-9d31-975bed1d7c4c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.013457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9202277-d0ea-4a0d-8081-51a8975972ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.014921 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9202277-d0ea-4a0d-8081-51a8975972ba None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.020369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-7b38e89a-7e04-4bb2-9d31-975bed1d7c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:16.021523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 253/511] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:16.022296 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38e89a-7e04-4bb2-9d31-975bed1d7c4c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.109829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 259/512] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:16.110672 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9202277-d0ea-4a0d-8081-51a8975972ba None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.117908 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38e89a-7e04-4bb2-9d31-975bed1d7c4c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.149985 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9dc76-e352-4863-81a0-502aa730f834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.150629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9dc76-e352-4863-81a0-502aa730f834 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.150920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9dc76-e352-4863-81a0-502aa730f834 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.151298 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9dc76-e352-4863-81a0-502aa730f834 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.152001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9dc76-e352-4863-81a0-502aa730f834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:16.152300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9dc76-e352-4863-81a0-502aa730f834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.153669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9dc76-e352-4863-81a0-502aa730f834 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.164835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 254/513] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:16.165613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9dc76-e352-4863-81a0-502aa730f834 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.209827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9202277-d0ea-4a0d-8081-51a8975972ba None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.241776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfa91b-c390-4a88-81ec-0223ce27d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.242651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfa91b-c390-4a88-81ec-0223ce27d7d6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.242958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfa91b-c390-4a88-81ec-0223ce27d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.243233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfa91b-c390-4a88-81ec-0223ce27d7d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.249633 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfa91b-c390-4a88-81ec-0223ce27d7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.251684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfa91b-c390-4a88-81ec-0223ce27d7d6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.257982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9dc76-e352-4863-81a0-502aa730f834 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.264432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-5cbfa91b-c390-4a88-81ec-0223ce27d7d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:16.265618 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 260/514] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:16.266385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfa91b-c390-4a88-81ec-0223ce27d7d6 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.289726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d54d5e-f6e2-4de7-8077-4b8b5e7e4f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.290525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54d5e-f6e2-4de7-8077-4b8b5e7e4f89 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.290795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54d5e-f6e2-4de7-8077-4b8b5e7e4f89 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.291104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54d5e-f6e2-4de7-8077-4b8b5e7e4f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.300867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d54d5e-f6e2-4de7-8077-4b8b5e7e4f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.302286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d54d5e-f6e2-4de7-8077-4b8b5e7e4f89 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.317973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-c0d54d5e-f6e2-4de7-8077-4b8b5e7e4f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:16.319137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 255/515] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:16.319890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d54d5e-f6e2-4de7-8077-4b8b5e7e4f89 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.367048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfa91b-c390-4a88-81ec-0223ce27d7d6 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.399143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c03e4a-73aa-4865-bcd3-79810cc46958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.399785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c03e4a-73aa-4865-bcd3-79810cc46958 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.400065 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c03e4a-73aa-4865-bcd3-79810cc46958 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.400339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c03e4a-73aa-4865-bcd3-79810cc46958 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.401045 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c03e4a-73aa-4865-bcd3-79810cc46958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:16.401350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c03e4a-73aa-4865-bcd3-79810cc46958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.402712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c03e4a-73aa-4865-bcd3-79810cc46958 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.411541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d54d5e-f6e2-4de7-8077-4b8b5e7e4f89 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.413995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 261/516] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:16.414769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c03e4a-73aa-4865-bcd3-79810cc46958 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.443508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c5ef7-6dee-4c9c-a4e5-203061a6ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.444280 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c5ef7-6dee-4c9c-a4e5-203061a6ef63 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.444563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c5ef7-6dee-4c9c-a4e5-203061a6ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.444834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c5ef7-6dee-4c9c-a4e5-203061a6ef63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.454806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c5ef7-6dee-4c9c-a4e5-203061a6ef63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.456262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c5ef7-6dee-4c9c-a4e5-203061a6ef63 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.472710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-eb4c5ef7-6dee-4c9c-a4e5-203061a6ef63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:16.473863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 256/517] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:16.474613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c5ef7-6dee-4c9c-a4e5-203061a6ef63 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.510684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c03e4a-73aa-4865-bcd3-79810cc46958 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.541854 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7907a7-aa86-4b20-8e37-7b28dd93a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.542625 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7907a7-aa86-4b20-8e37-7b28dd93a4ac None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.542924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7907a7-aa86-4b20-8e37-7b28dd93a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.543202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7907a7-aa86-4b20-8e37-7b28dd93a4ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.550283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7907a7-aa86-4b20-8e37-7b28dd93a4ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.551721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7907a7-aa86-4b20-8e37-7b28dd93a4ac None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.565022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-3f7907a7-aa86-4b20-8e37-7b28dd93a4ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 10:25:16.566047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c5ef7-6dee-4c9c-a4e5-203061a6ef63 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.566455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 262/518] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:16.567254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7907a7-aa86-4b20-8e37-7b28dd93a4ac None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.598390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff5e95-3aa9-4343-9381-90eb50829069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.599061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5e95-3aa9-4343-9381-90eb50829069 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.599342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5e95-3aa9-4343-9381-90eb50829069 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.599611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5e95-3aa9-4343-9381-90eb50829069 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.600377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff5e95-3aa9-4343-9381-90eb50829069 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:16.600679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff5e95-3aa9-4343-9381-90eb50829069 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.602106 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff5e95-3aa9-4343-9381-90eb50829069 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.619307 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 257/519] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:16.620005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff5e95-3aa9-4343-9381-90eb50829069 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.662646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7907a7-aa86-4b20-8e37-7b28dd93a4ac None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.693971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ae10b-58d4-4e73-9da1-d04b4da828bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.694617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ae10b-58d4-4e73-9da1-d04b4da828bb None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.694891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ae10b-58d4-4e73-9da1-d04b4da828bb None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.695192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ae10b-58d4-4e73-9da1-d04b4da828bb None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.695896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ae10b-58d4-4e73-9da1-d04b4da828bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:16.696198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ae10b-58d4-4e73-9da1-d04b4da828bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.697562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ae10b-58d4-4e73-9da1-d04b4da828bb None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.708620 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 263/520] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:16.709396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ae10b-58d4-4e73-9da1-d04b4da828bb None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.713535 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff5e95-3aa9-4343-9381-90eb50829069 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.745673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8792d-3ce3-4651-9d8b-3d0c7dff8508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.746341 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8792d-3ce3-4651-9d8b-3d0c7dff8508 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.746614 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8792d-3ce3-4651-9d8b-3d0c7dff8508 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.746887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8792d-3ce3-4651-9d8b-3d0c7dff8508 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.747605 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8792d-3ce3-4651-9d8b-3d0c7dff8508 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.749030 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8792d-3ce3-4651-9d8b-3d0c7dff8508 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.768673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 258/521] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:25:16 2022] POST /identity/v3/users => generated 247 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:25:16.769449 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8792d-3ce3-4651-9d8b-3d0c7dff8508 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.806563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ae10b-58d4-4e73-9da1-d04b4da828bb None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.842431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e1f90-934e-41af-ace4-2bbad268cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.843275 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e1f90-934e-41af-ace4-2bbad268cae9 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.843561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e1f90-934e-41af-ace4-2bbad268cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.843829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e1f90-934e-41af-ace4-2bbad268cae9 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.844570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e1f90-934e-41af-ace4-2bbad268cae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:16.844875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e1f90-934e-41af-ace4-2bbad268cae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.846290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e1f90-934e-41af-ace4-2bbad268cae9 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.858202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 264/522] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:16.859102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e1f90-934e-41af-ace4-2bbad268cae9 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.875518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8792d-3ce3-4651-9d8b-3d0c7dff8508 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.910923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3660ed-c282-4007-b3d2-3e4ed0eb307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.911347 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3660ed-c282-4007-b3d2-3e4ed0eb307b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.911624 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3660ed-c282-4007-b3d2-3e4ed0eb307b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.911922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3660ed-c282-4007-b3d2-3e4ed0eb307b None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.912781 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3660ed-c282-4007-b3d2-3e4ed0eb307b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:16.913045 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3660ed-c282-4007-b3d2-3e4ed0eb307b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.914505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3660ed-c282-4007-b3d2-3e4ed0eb307b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.933134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 259/523] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:16.934374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3660ed-c282-4007-b3d2-3e4ed0eb307b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.968026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e1f90-934e-41af-ace4-2bbad268cae9 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:17.008934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d30942-3581-4cd1-824e-c77164808a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:17.008934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d30942-3581-4cd1-824e-c77164808a52 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.008934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d30942-3581-4cd1-824e-c77164808a52 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.008934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d30942-3581-4cd1-824e-c77164808a52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.009340 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d30942-3581-4cd1-824e-c77164808a52 None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=b4132c15e66a4a619574f7aba10d6d71) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:17.009340 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d30942-3581-4cd1-824e-c77164808a52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:17.009340 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d30942-3581-4cd1-824e-c77164808a52 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:17.013002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 265/524] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/role_assignments?user.id=b4132c15e66a4a619574f7aba10d6d71&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:17.013624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d30942-3581-4cd1-824e-c77164808a52 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:17.036211 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3660ed-c282-4007-b3d2-3e4ed0eb307b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:17.073034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8997be4-1e12-40d5-95d5-b297d10e7e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:17.073847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997be4-1e12-40d5-95d5-b297d10e7e7b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.074117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997be4-1e12-40d5-95d5-b297d10e7e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.074379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997be4-1e12-40d5-95d5-b297d10e7e7b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.082651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8997be4-1e12-40d5-95d5-b297d10e7e7b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:17.084133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8997be4-1e12-40d5-95d5-b297d10e7e7b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:17.098501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e8997be4-1e12-40d5-95d5-b297d10e7e7b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 10:25:17.100152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 260/525] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:17.101036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8997be4-1e12-40d5-95d5-b297d10e7e7b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:17.123939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d30942-3581-4cd1-824e-c77164808a52 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:17.160106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c8427-7035-4500-95a4-8a81c3e3e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:17.160826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c8427-7035-4500-95a4-8a81c3e3e556 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.161106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c8427-7035-4500-95a4-8a81c3e3e556 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.161377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c8427-7035-4500-95a4-8a81c3e3e556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.168956 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c8427-7035-4500-95a4-8a81c3e3e556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:17.170445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c8427-7035-4500-95a4-8a81c3e3e556 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:17.185363 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-c10c8427-7035-4500-95a4-8a81c3e3e556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:17.186935 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 266/526] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:17.188348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c8427-7035-4500-95a4-8a81c3e3e556 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:17.207490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8997be4-1e12-40d5-95d5-b297d10e7e7b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:17.248485 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5161b5-1078-41ee-973a-29820575aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:17.249135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5161b5-1078-41ee-973a-29820575aa0c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.249413 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5161b5-1078-41ee-973a-29820575aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.249677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5161b5-1078-41ee-973a-29820575aa0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.296823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c8427-7035-4500-95a4-8a81c3e3e556 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:17.326396 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5161b5-1078-41ee-973a-29820575aa0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:17.327983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5161b5-1078-41ee-973a-29820575aa0c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:17.344462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ded9dc-70c5-43ac-880c-983ccb77f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:17.345818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded9dc-70c5-43ac-880c-983ccb77f3a3 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.346300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded9dc-70c5-43ac-880c-983ccb77f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.346784 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded9dc-70c5-43ac-880c-983ccb77f3a3 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.347844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ded9dc-70c5-43ac-880c-983ccb77f3a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:17.348748 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ded9dc-70c5-43ac-880c-983ccb77f3a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:17.350781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ded9dc-70c5-43ac-880c-983ccb77f3a3 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:17.369896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 267/527] 10.222.0.44 () {56 vars in 1139 bytes} [Mon Feb 28 10:25:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:17.371055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ded9dc-70c5-43ac-880c-983ccb77f3a3 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:17.435424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 261/528] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:17.436966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5161b5-1078-41ee-973a-29820575aa0c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:17.473278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ded9dc-70c5-43ac-880c-983ccb77f3a3 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:17.507975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed6016-3b1e-4b4a-9193-d56389c0b04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:17.508991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed6016-3b1e-4b4a-9193-d56389c0b04e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.509485 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed6016-3b1e-4b4a-9193-d56389c0b04e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.509948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed6016-3b1e-4b4a-9193-d56389c0b04e None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.511190 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed6016-3b1e-4b4a-9193-d56389c0b04e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:17.512091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed6016-3b1e-4b4a-9193-d56389c0b04e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:17.514071 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed6016-3b1e-4b4a-9193-d56389c0b04e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:17.536578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5161b5-1078-41ee-973a-29820575aa0c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:17.538058 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 268/529] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:17.539960 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed6016-3b1e-4b4a-9193-d56389c0b04e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:17.573964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5546ddd-914d-41d3-9921-b6afdef5fba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:17.574608 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5546ddd-914d-41d3-9921-b6afdef5fba2 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.574883 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5546ddd-914d-41d3-9921-b6afdef5fba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.575191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5546ddd-914d-41d3-9921-b6afdef5fba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.642480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed6016-3b1e-4b4a-9193-d56389c0b04e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:17.644975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5546ddd-914d-41d3-9921-b6afdef5fba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:17.646445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5546ddd-914d-41d3-9921-b6afdef5fba2 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:17.677350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec44813-af81-4ca7-94e9-6d2365453cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:17.678473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec44813-af81-4ca7-94e9-6d2365453cb6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.678981 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec44813-af81-4ca7-94e9-6d2365453cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.679451 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec44813-af81-4ca7-94e9-6d2365453cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.689925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec44813-af81-4ca7-94e9-6d2365453cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:17.691662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec44813-af81-4ca7-94e9-6d2365453cb6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:17.710353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-2ec44813-af81-4ca7-94e9-6d2365453cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:17.712242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 269/530] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:17.713273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec44813-af81-4ca7-94e9-6d2365453cb6 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:17.752822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 262/531] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:17.754120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5546ddd-914d-41d3-9921-b6afdef5fba2 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:17.839232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec44813-af81-4ca7-94e9-6d2365453cb6 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:17.852483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5546ddd-914d-41d3-9921-b6afdef5fba2 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:17.878329 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980cdaa-2f59-4ef1-853f-c1f3515a9e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:17.879072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980cdaa-2f59-4ef1-853f-c1f3515a9e24 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.879356 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980cdaa-2f59-4ef1-853f-c1f3515a9e24 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.880105 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980cdaa-2f59-4ef1-853f-c1f3515a9e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.881217 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980cdaa-2f59-4ef1-853f-c1f3515a9e24 None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=e1c59b4bb1774e1badd132071859f503) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:17.881531 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980cdaa-2f59-4ef1-853f-c1f3515a9e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:17.883494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980cdaa-2f59-4ef1-853f-c1f3515a9e24 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:17.891995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 270/532] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:17 2022] GET /identity/v3/role_assignments?user.id=e1c59b4bb1774e1badd132071859f503&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:17.892793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980cdaa-2f59-4ef1-853f-c1f3515a9e24 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:17.894798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2c986-a8fb-4d4c-87bf-84690beda32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:17.895853 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2c986-a8fb-4d4c-87bf-84690beda32a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.897063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2c986-a8fb-4d4c-87bf-84690beda32a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.897345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2c986-a8fb-4d4c-87bf-84690beda32a None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.898093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2c986-a8fb-4d4c-87bf-84690beda32a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:17.898446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2c986-a8fb-4d4c-87bf-84690beda32a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:17.899916 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2c986-a8fb-4d4c-87bf-84690beda32a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:17.922943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 263/533] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:17.928515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2c986-a8fb-4d4c-87bf-84690beda32a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:18.067055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980cdaa-2f59-4ef1-853f-c1f3515a9e24 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:18.113824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151581c0-66cb-4795-b156-86f4c027f707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:18.114617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151581c0-66cb-4795-b156-86f4c027f707 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:18.115015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151581c0-66cb-4795-b156-86f4c027f707 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:18.115322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151581c0-66cb-4795-b156-86f4c027f707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:18.126419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151581c0-66cb-4795-b156-86f4c027f707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:18.127918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151581c0-66cb-4795-b156-86f4c027f707 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:18.131626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2c986-a8fb-4d4c-87bf-84690beda32a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:18.145265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-151581c0-66cb-4795-b156-86f4c027f707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:18.146762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 271/534] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:18.152288 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151581c0-66cb-4795-b156-86f4c027f707 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:18.169062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ff3a7-6dba-4a53-9e9f-5f2263d0ea9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:18.169856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ff3a7-6dba-4a53-9e9f-5f2263d0ea9f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:18.170133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ff3a7-6dba-4a53-9e9f-5f2263d0ea9f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:18.170399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ff3a7-6dba-4a53-9e9f-5f2263d0ea9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:18.178611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ff3a7-6dba-4a53-9e9f-5f2263d0ea9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:18.180496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ff3a7-6dba-4a53-9e9f-5f2263d0ea9f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:18.196352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-a92ff3a7-6dba-4a53-9e9f-5f2263d0ea9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:18.197993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 264/535] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:18.205241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ff3a7-6dba-4a53-9e9f-5f2263d0ea9f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:18.316689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151581c0-66cb-4795-b156-86f4c027f707 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:18.348718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ff3a7-6dba-4a53-9e9f-5f2263d0ea9f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:18.375597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda4f5c-f208-41f2-9d4d-30379963ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:18.376521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda4f5c-f208-41f2-9d4d-30379963ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:18.376949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda4f5c-f208-41f2-9d4d-30379963ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:18.377366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda4f5c-f208-41f2-9d4d-30379963ddc6 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:18.378238 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda4f5c-f208-41f2-9d4d-30379963ddc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:18.379340 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda4f5c-f208-41f2-9d4d-30379963ddc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:18.380743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda4f5c-f208-41f2-9d4d-30379963ddc6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:18.399296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 272/536] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:18.401819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7fa0a-8a58-4635-bac5-5b8ee33fccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:18.402475 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7fa0a-8a58-4635-bac5-5b8ee33fccfc None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:18.402748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7fa0a-8a58-4635-bac5-5b8ee33fccfc None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:18.403071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7fa0a-8a58-4635-bac5-5b8ee33fccfc None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:18.404572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda4f5c-f208-41f2-9d4d-30379963ddc6 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:18.405457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7fa0a-8a58-4635-bac5-5b8ee33fccfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:18.405757 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7fa0a-8a58-4635-bac5-5b8ee33fccfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:18.408386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7fa0a-8a58-4635-bac5-5b8ee33fccfc None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:18.430382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 265/537] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:18.438626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7fa0a-8a58-4635-bac5-5b8ee33fccfc None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:18.529965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda4f5c-f208-41f2-9d4d-30379963ddc6 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:18.566805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c051b9d-7280-41c1-ba48-bc390d5a26d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:18.567617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051b9d-7280-41c1-ba48-bc390d5a26d4 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:18.567893 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051b9d-7280-41c1-ba48-bc390d5a26d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:18.568163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051b9d-7280-41c1-ba48-bc390d5a26d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:18.575482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c051b9d-7280-41c1-ba48-bc390d5a26d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:18.576921 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c051b9d-7280-41c1-ba48-bc390d5a26d4 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:18.591214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-5c051b9d-7280-41c1-ba48-bc390d5a26d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:18.593209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 273/538] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:18.598325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c051b9d-7280-41c1-ba48-bc390d5a26d4 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:18.701153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7fa0a-8a58-4635-bac5-5b8ee33fccfc None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:18.725654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c051b9d-7280-41c1-ba48-bc390d5a26d4 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:18.777012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764a9a9-0c8f-4673-ace4-4b66e85c36ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:18.778047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764a9a9-0c8f-4673-ace4-4b66e85c36ee None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:18.778523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764a9a9-0c8f-4673-ace4-4b66e85c36ee None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:18.779016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764a9a9-0c8f-4673-ace4-4b66e85c36ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:18.780036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764a9a9-0c8f-4673-ace4-4b66e85c36ee None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=80ad61a348b2450baceb030f98150647) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:18.780586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764a9a9-0c8f-4673-ace4-4b66e85c36ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:18.782283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764a9a9-0c8f-4673-ace4-4b66e85c36ee None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:18.792868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 266/539] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:18 2022] GET /identity/v3/role_assignments?user.id=80ad61a348b2450baceb030f98150647&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 259 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:18.794609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc1f39-0fb9-4d26-be66-d89898f0b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:18.795589 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc1f39-0fb9-4d26-be66-d89898f0b01d None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:18.796103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc1f39-0fb9-4d26-be66-d89898f0b01d None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:18.796575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc1f39-0fb9-4d26-be66-d89898f0b01d None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:18.797610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc1f39-0fb9-4d26-be66-d89898f0b01d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:18.798151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc1f39-0fb9-4d26-be66-d89898f0b01d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:18.799889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc1f39-0fb9-4d26-be66-d89898f0b01d None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:18.820702 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 274/540] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:18.826817 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764a9a9-0c8f-4673-ace4-4b66e85c36ee None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:18.959615 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764a9a9-0c8f-4673-ace4-4b66e85c36ee None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:19.012099 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13434a-cdde-4ebc-b42b-68e278a97877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:19.013124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13434a-cdde-4ebc-b42b-68e278a97877 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:19.013632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13434a-cdde-4ebc-b42b-68e278a97877 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:19.014107 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13434a-cdde-4ebc-b42b-68e278a97877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:19.015173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13434a-cdde-4ebc-b42b-68e278a97877 None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=44fb3491570c41cbb7271cfce1c31e39) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:19.015789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13434a-cdde-4ebc-b42b-68e278a97877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:19.017418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13434a-cdde-4ebc-b42b-68e278a97877 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:19.023905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 267/541] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:18 2022] GET /identity/v3/role_assignments?user.id=44fb3491570c41cbb7271cfce1c31e39&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:19.473883 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf680d4-900a-43db-9651-00c681aee1c6 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:19.474257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf680d4-900a-43db-9651-00c681aee1c6 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:19.474449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf680d4-900a-43db-9651-00c681aee1c6 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:19.476478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 275/542] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:19.481748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b96d9-0bcc-47a7-b7f2-1be3fc084752 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:19.482181 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b96d9-0bcc-47a7-b7f2-1be3fc084752 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:19.482364 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b96d9-0bcc-47a7-b7f2-1be3fc084752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:19.498936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-f21b96d9-0bcc-47a7-b7f2-1be3fc084752 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:19.500639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f21b96d9-0bcc-47a7-b7f2-1be3fc084752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:19.575094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 268/543] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:19.576729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93cb5e-d419-40c2-a7cd-4b163510f395 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:19.577011 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93cb5e-d419-40c2-a7cd-4b163510f395 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:19.577285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93cb5e-d419-40c2-a7cd-4b163510f395 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:19.579605 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 276/544] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:19.584710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8fa1-1cbd-4393-bf30-cde36699a4b2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:19.584998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8fa1-1cbd-4393-bf30-cde36699a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:19.585272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8fa1-1cbd-4393-bf30-cde36699a4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:19.604034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a05c8fa1-1cbd-4393-bf30-cde36699a4b2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:19.605244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a05c8fa1-1cbd-4393-bf30-cde36699a4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:19.651423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93cb5e-d419-40c2-a7cd-4b163510f395 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:19.713054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 269/545] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:19.749092 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c8fa1-1cbd-4393-bf30-cde36699a4b2 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:19.779924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93cb5e-d419-40c2-a7cd-4b163510f395 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:19.814373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bc0d1-f15a-49d6-b790-1a313d5992d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:19.815185 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bc0d1-f15a-49d6-b790-1a313d5992d3 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:19.815466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bc0d1-f15a-49d6-b790-1a313d5992d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:19.815740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bc0d1-f15a-49d6-b790-1a313d5992d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:19.826075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bc0d1-f15a-49d6-b790-1a313d5992d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:19.836515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-4a3bc0d1-f15a-49d6-b790-1a313d5992d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:19.836515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 277/546] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:19.840303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bc0d1-f15a-49d6-b790-1a313d5992d3 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:19.939974 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bc0d1-f15a-49d6-b790-1a313d5992d3 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:19.967667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c8fa1-1cbd-4393-bf30-cde36699a4b2 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:19.973426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fd43d-ea1f-4a57-823f-b5db540f1a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:19.974095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fd43d-ea1f-4a57-823f-b5db540f1a6d None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:19.974374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fd43d-ea1f-4a57-823f-b5db540f1a6d None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:19.974647 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fd43d-ea1f-4a57-823f-b5db540f1a6d None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:19.975413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fd43d-ea1f-4a57-823f-b5db540f1a6d None admin] RBAC: Adding query filter params (name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:19.975718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fd43d-ea1f-4a57-823f-b5db540f1a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:19.977076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fd43d-ea1f-4a57-823f-b5db540f1a6d None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:19.986450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 278/547] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:19.991753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fd43d-ea1f-4a57-823f-b5db540f1a6d None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:20.048053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17573ec6-2510-4eae-8ff7-836d9165516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:20.048773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17573ec6-2510-4eae-8ff7-836d9165516b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.049045 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17573ec6-2510-4eae-8ff7-836d9165516b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.049312 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17573ec6-2510-4eae-8ff7-836d9165516b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.071879 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17573ec6-2510-4eae-8ff7-836d9165516b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:20.086932 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-17573ec6-2510-4eae-8ff7-836d9165516b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:20.088820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 270/548] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:20.094564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17573ec6-2510-4eae-8ff7-836d9165516b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:20.103472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fd43d-ea1f-4a57-823f-b5db540f1a6d None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:20.138609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94d338-f303-4950-a9f2-de7975ac9789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:20.139426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94d338-f303-4950-a9f2-de7975ac9789 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.139705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94d338-f303-4950-a9f2-de7975ac9789 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.140032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94d338-f303-4950-a9f2-de7975ac9789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.154929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94d338-f303-4950-a9f2-de7975ac9789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:20.154929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94d338-f303-4950-a9f2-de7975ac9789 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:20.169304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-ee94d338-f303-4950-a9f2-de7975ac9789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:20.170813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 279/549] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:20.176746 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94d338-f303-4950-a9f2-de7975ac9789 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:20.281675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94d338-f303-4950-a9f2-de7975ac9789 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:20.315861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea099e4c-3f67-4a0b-82e8-b08e4d6bb2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:20.316442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea099e4c-3f67-4a0b-82e8-b08e4d6bb2d7 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.316721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea099e4c-3f67-4a0b-82e8-b08e4d6bb2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.316996 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea099e4c-3f67-4a0b-82e8-b08e4d6bb2d7 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.317707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea099e4c-3f67-4a0b-82e8-b08e4d6bb2d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:20.318011 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea099e4c-3f67-4a0b-82e8-b08e4d6bb2d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:20.319401 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea099e4c-3f67-4a0b-82e8-b08e4d6bb2d7 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:20.332519 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 280/550] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:20.337733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea099e4c-3f67-4a0b-82e8-b08e4d6bb2d7 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:20.338393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17573ec6-2510-4eae-8ff7-836d9165516b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:20.405145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a4ee9-192c-45f8-9450-7bae20a32f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:20.405859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4ee9-192c-45f8-9450-7bae20a32f1e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.406671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4ee9-192c-45f8-9450-7bae20a32f1e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.406957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4ee9-192c-45f8-9450-7bae20a32f1e None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.407700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a4ee9-192c-45f8-9450-7bae20a32f1e None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:20.407999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a4ee9-192c-45f8-9450-7bae20a32f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:20.409375 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a4ee9-192c-45f8-9450-7bae20a32f1e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:20.427332 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 271/551] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:20.431861 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a4ee9-192c-45f8-9450-7bae20a32f1e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:20.437208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea099e4c-3f67-4a0b-82e8-b08e4d6bb2d7 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:20.471120 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4ff3-fe4a-4fc6-abc0-d8d510780083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:20.471908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4ff3-fe4a-4fc6-abc0-d8d510780083 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.472186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4ff3-fe4a-4fc6-abc0-d8d510780083 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.472477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4ff3-fe4a-4fc6-abc0-d8d510780083 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.479565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd4ff3-fe4a-4fc6-abc0-d8d510780083 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:20.480990 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd4ff3-fe4a-4fc6-abc0-d8d510780083 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:20.495106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-27dd4ff3-fe4a-4fc6-abc0-d8d510780083 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:25:20.496437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 281/552] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:20.501693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4ff3-fe4a-4fc6-abc0-d8d510780083 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:20.601130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4ff3-fe4a-4fc6-abc0-d8d510780083 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:20.636910 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35158031-e0f5-472c-a3af-e8d460f2ee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:20.637580 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158031-e0f5-472c-a3af-e8d460f2ee4c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.637859 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158031-e0f5-472c-a3af-e8d460f2ee4c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.638131 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158031-e0f5-472c-a3af-e8d460f2ee4c None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.638990 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35158031-e0f5-472c-a3af-e8d460f2ee4c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:20.639326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35158031-e0f5-472c-a3af-e8d460f2ee4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:20.646928 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35158031-e0f5-472c-a3af-e8d460f2ee4c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:20.658517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 282/553] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Feb 28 10:25:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:20.663852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35158031-e0f5-472c-a3af-e8d460f2ee4c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:20.665255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a4ee9-192c-45f8-9450-7bae20a32f1e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:20.710424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76849869-d01d-4a4e-b1e8-9a9125702281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:20.711238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76849869-d01d-4a4e-b1e8-9a9125702281 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.711600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76849869-d01d-4a4e-b1e8-9a9125702281 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.711776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76849869-d01d-4a4e-b1e8-9a9125702281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.722291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76849869-d01d-4a4e-b1e8-9a9125702281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:20.723784 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76849869-d01d-4a4e-b1e8-9a9125702281 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:20.740157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-76849869-d01d-4a4e-b1e8-9a9125702281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:20.741645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 272/554] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:20.742955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb9fb2-5efe-4b95-9f4b-af7403f8a6df None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.743238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb9fb2-5efe-4b95-9f4b-af7403f8a6df None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.743516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb9fb2-5efe-4b95-9f4b-af7403f8a6df None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.745407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 273/555] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:20.746584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb9fb2-5efe-4b95-9f4b-af7403f8a6df None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:20.770608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35158031-e0f5-472c-a3af-e8d460f2ee4c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:20.817295 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b6192-d0ed-4a1d-b86c-2eb1738eba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:20.818180 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b6192-d0ed-4a1d-b86c-2eb1738eba4f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.818596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b6192-d0ed-4a1d-b86c-2eb1738eba4f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.818997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b6192-d0ed-4a1d-b86c-2eb1738eba4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.859999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb9fb2-5efe-4b95-9f4b-af7403f8a6df None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:20.891561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b6192-d0ed-4a1d-b86c-2eb1738eba4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:20.893306 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b6192-d0ed-4a1d-b86c-2eb1738eba4f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:20.901007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a473cd5-3701-4ff8-85a7-d9be1ac22436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:20.902079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a473cd5-3701-4ff8-85a7-d9be1ac22436 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.902360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a473cd5-3701-4ff8-85a7-d9be1ac22436 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.902633 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a473cd5-3701-4ff8-85a7-d9be1ac22436 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.903368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a473cd5-3701-4ff8-85a7-d9be1ac22436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:20.903672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a473cd5-3701-4ff8-85a7-d9be1ac22436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:20.905381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a473cd5-3701-4ff8-85a7-d9be1ac22436 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:20.921276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 274/556] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:20.923059 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fc4a6-4f00-435b-ba5a-4bf638da3ba2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.923350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fc4a6-4f00-435b-ba5a-4bf638da3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.923894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fc4a6-4f00-435b-ba5a-4bf638da3ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.944214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-233fc4a6-4f00-435b-ba5a-4bf638da3ba2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:20.945388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-233fc4a6-4f00-435b-ba5a-4bf638da3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:21.006989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 283/557] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:25:21.008227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b6192-d0ed-4a1d-b86c-2eb1738eba4f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:21.023345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 275/558] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:21.024589 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fc4a6-4f00-435b-ba5a-4bf638da3ba2 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:21.132697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b6192-d0ed-4a1d-b86c-2eb1738eba4f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:21.139733 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fc4a6-4f00-435b-ba5a-4bf638da3ba2 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:21.170025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec589474-5896-4e2c-ac9d-d2cc73a97f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:21.170403 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589474-5896-4e2c-ac9d-d2cc73a97f99 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.170687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589474-5896-4e2c-ac9d-d2cc73a97f99 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.171001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589474-5896-4e2c-ac9d-d2cc73a97f99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.178482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec589474-5896-4e2c-ac9d-d2cc73a97f99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:21.179965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec589474-5896-4e2c-ac9d-d2cc73a97f99 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:21.187913 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dc89b-456a-440b-a7f0-80c6f5f5d9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:21.188981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dc89b-456a-440b-a7f0-80c6f5f5d9d3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.189470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dc89b-456a-440b-a7f0-80c6f5f5d9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.189947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dc89b-456a-440b-a7f0-80c6f5f5d9d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.194098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-ec589474-5896-4e2c-ac9d-d2cc73a97f99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:25:21.195644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 284/559] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:21.196485 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec589474-5896-4e2c-ac9d-d2cc73a97f99 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:21.202444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dc89b-456a-440b-a7f0-80c6f5f5d9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:21.204264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dc89b-456a-440b-a7f0-80c6f5f5d9d3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:21.227062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-9f2dc89b-456a-440b-a7f0-80c6f5f5d9d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:21.233454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 276/560] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:21.233454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dc89b-456a-440b-a7f0-80c6f5f5d9d3 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:21.299455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec589474-5896-4e2c-ac9d-d2cc73a97f99 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:21.340348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d0f39-e370-4c07-9be7-41b2a6977dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:21.342011 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d0f39-e370-4c07-9be7-41b2a6977dcf None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.342477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d0f39-e370-4c07-9be7-41b2a6977dcf None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.343109 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d0f39-e370-4c07-9be7-41b2a6977dcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.349453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dc89b-456a-440b-a7f0-80c6f5f5d9d3 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:21.356367 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d0f39-e370-4c07-9be7-41b2a6977dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:21.365839 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-ce8d0f39-e370-4c07-9be7-41b2a6977dcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:21.368062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 285/561] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:21.369022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d0f39-e370-4c07-9be7-41b2a6977dcf None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:21.393338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fa67f-434f-40ee-a3a8-e3d3e1bac7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:21.393937 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fa67f-434f-40ee-a3a8-e3d3e1bac7b5 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.394213 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fa67f-434f-40ee-a3a8-e3d3e1bac7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.394481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fa67f-434f-40ee-a3a8-e3d3e1bac7b5 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.395382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fa67f-434f-40ee-a3a8-e3d3e1bac7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:21.396114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fa67f-434f-40ee-a3a8-e3d3e1bac7b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:21.397821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fa67f-434f-40ee-a3a8-e3d3e1bac7b5 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:21.419752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 277/562] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:21.421206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fa67f-434f-40ee-a3a8-e3d3e1bac7b5 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:21.477205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d0f39-e370-4c07-9be7-41b2a6977dcf None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:21.517136 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40138ed-8494-4df9-b494-ea3efc946b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:21.517804 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40138ed-8494-4df9-b494-ea3efc946b9f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.518153 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40138ed-8494-4df9-b494-ea3efc946b9f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.518595 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40138ed-8494-4df9-b494-ea3efc946b9f None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.519372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40138ed-8494-4df9-b494-ea3efc946b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:21.519681 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40138ed-8494-4df9-b494-ea3efc946b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:21.521055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40138ed-8494-4df9-b494-ea3efc946b9f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:21.532972 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 286/563] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:21.533611 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40138ed-8494-4df9-b494-ea3efc946b9f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:21.545725 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fa67f-434f-40ee-a3a8-e3d3e1bac7b5 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:21.580119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec9674-3c30-438a-8cac-762edb59d33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:21.580777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec9674-3c30-438a-8cac-762edb59d33a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.581241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec9674-3c30-438a-8cac-762edb59d33a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.581711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec9674-3c30-438a-8cac-762edb59d33a None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.582585 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec9674-3c30-438a-8cac-762edb59d33a None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:21.583082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec9674-3c30-438a-8cac-762edb59d33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:21.584577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec9674-3c30-438a-8cac-762edb59d33a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:21.592634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 278/564] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:21.594107 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9c3ac-47a8-4dc6-9ef7-a7755b6cf481 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.594387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9c3ac-47a8-4dc6-9ef7-a7755b6cf481 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.594655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9c3ac-47a8-4dc6-9ef7-a7755b6cf481 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.598940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 279/565] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:21.598940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9c3ac-47a8-4dc6-9ef7-a7755b6cf481 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:21.638822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40138ed-8494-4df9-b494-ea3efc946b9f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:21.673153 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f3613-effb-45ed-ba89-07618f335915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:21.674198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f3613-effb-45ed-ba89-07618f335915 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.674669 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f3613-effb-45ed-ba89-07618f335915 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.675039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f3613-effb-45ed-ba89-07618f335915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.685043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f3613-effb-45ed-ba89-07618f335915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:21.686479 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f3613-effb-45ed-ba89-07618f335915 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:21.695763 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9c3ac-47a8-4dc6-9ef7-a7755b6cf481 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:21.704803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-563f3613-effb-45ed-ba89-07618f335915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:21.706165 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 287/566] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:21.706756 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f3613-effb-45ed-ba89-07618f335915 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:21.729152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d77577-91e4-4a26-bd9a-c3605cdfd4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:21.729938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77577-91e4-4a26-bd9a-c3605cdfd4e6 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.730206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77577-91e4-4a26-bd9a-c3605cdfd4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.730532 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77577-91e4-4a26-bd9a-c3605cdfd4e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.737686 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d77577-91e4-4a26-bd9a-c3605cdfd4e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:21.739144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d77577-91e4-4a26-bd9a-c3605cdfd4e6 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:21.761280 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-78d77577-91e4-4a26-bd9a-c3605cdfd4e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:21.767168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 280/567] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:21.767168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c5198-d0de-4e69-ae40-8f1374408fc0 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.767168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c5198-d0de-4e69-ae40-8f1374408fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.767168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c5198-d0de-4e69-ae40-8f1374408fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.784884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-9a4c5198-d0de-4e69-ae40-8f1374408fc0 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:21.786056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9a4c5198-d0de-4e69-ae40-8f1374408fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:21.812095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f3613-effb-45ed-ba89-07618f335915 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:21.845398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bf745-829e-44f8-a063-e5136c59e88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:21.846178 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bf745-829e-44f8-a063-e5136c59e88e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.846457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bf745-829e-44f8-a063-e5136c59e88e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.846724 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bf745-829e-44f8-a063-e5136c59e88e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.849664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 281/568] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:21.850493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c5198-d0de-4e69-ae40-8f1374408fc0 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:21.856421 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bf745-829e-44f8-a063-e5136c59e88e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:21.857854 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bf745-829e-44f8-a063-e5136c59e88e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:21.875080 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-254bf745-829e-44f8-a063-e5136c59e88e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:21.876257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 288/569] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:21.877017 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bf745-829e-44f8-a063-e5136c59e88e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:21.943400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c5198-d0de-4e69-ae40-8f1374408fc0 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:21.970418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bf745-829e-44f8-a063-e5136c59e88e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:21.975295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a167dc-2bea-4d9c-8799-46295039a296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:21.975944 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a167dc-2bea-4d9c-8799-46295039a296 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.976224 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a167dc-2bea-4d9c-8799-46295039a296 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.976493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a167dc-2bea-4d9c-8799-46295039a296 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.977195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a167dc-2bea-4d9c-8799-46295039a296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:21.977496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a167dc-2bea-4d9c-8799-46295039a296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:21.978856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a167dc-2bea-4d9c-8799-46295039a296 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:21.990040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 282/570] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:21.991270 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82027b5f-70a9-4e11-8530-3d79c1540748 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:21.991553 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82027b5f-70a9-4e11-8530-3d79c1540748 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:21.991825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82027b5f-70a9-4e11-8530-3d79c1540748 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:21.993559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 283/571] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:21.994112 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82027b5f-70a9-4e11-8530-3d79c1540748 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.004179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bedf4-9459-4b69-ac54-8d51adf7eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.004837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bedf4-9459-4b69-ac54-8d51adf7eaa7 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.005115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bedf4-9459-4b69-ac54-8d51adf7eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.005388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bedf4-9459-4b69-ac54-8d51adf7eaa7 None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.006163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bedf4-9459-4b69-ac54-8d51adf7eaa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:22.006467 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bedf4-9459-4b69-ac54-8d51adf7eaa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:22.007906 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bedf4-9459-4b69-ac54-8d51adf7eaa7 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:22.024423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 289/572] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:22.024423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bedf4-9459-4b69-ac54-8d51adf7eaa7 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.096899 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82027b5f-70a9-4e11-8530-3d79c1540748 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.118833 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bedf4-9459-4b69-ac54-8d51adf7eaa7 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.129165 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbcf4c-1a37-4133-9350-1176f16633cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.129953 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbcf4c-1a37-4133-9350-1176f16633cd None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.130229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbcf4c-1a37-4133-9350-1176f16633cd None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.130497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbcf4c-1a37-4133-9350-1176f16633cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.140355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbcf4c-1a37-4133-9350-1176f16633cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:22.147620 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-aafbcf4c-1a37-4133-9350-1176f16633cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:22.148776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 284/573] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:22.149544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbcf4c-1a37-4133-9350-1176f16633cd None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.151034 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e4568-a98d-47f4-bb49-ec10c0b6f7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.151687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e4568-a98d-47f4-bb49-ec10c0b6f7f6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.151966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e4568-a98d-47f4-bb49-ec10c0b6f7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.152249 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e4568-a98d-47f4-bb49-ec10c0b6f7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.152948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e4568-a98d-47f4-bb49-ec10c0b6f7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:22.153251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e4568-a98d-47f4-bb49-ec10c0b6f7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:22.154600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e4568-a98d-47f4-bb49-ec10c0b6f7f6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:22.166171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 290/574] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:22.167345 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec6971-241c-4b67-ae8c-8a5535dd419a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.167635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec6971-241c-4b67-ae8c-8a5535dd419a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.167909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec6971-241c-4b67-ae8c-8a5535dd419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.183736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-34ec6971-241c-4b67-ae8c-8a5535dd419a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:22.184907 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-34ec6971-241c-4b67-ae8c-8a5535dd419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:22.245710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbcf4c-1a37-4133-9350-1176f16633cd None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.247118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 291/575] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:22.247770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec6971-241c-4b67-ae8c-8a5535dd419a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.281328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65db4c6-99f5-48c7-a169-c9d79d15077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.282110 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65db4c6-99f5-48c7-a169-c9d79d15077a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.282392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65db4c6-99f5-48c7-a169-c9d79d15077a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.282666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65db4c6-99f5-48c7-a169-c9d79d15077a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.289217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65db4c6-99f5-48c7-a169-c9d79d15077a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:22.290755 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65db4c6-99f5-48c7-a169-c9d79d15077a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:22.304246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e65db4c6-99f5-48c7-a169-c9d79d15077a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:22.305396 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 285/576] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:22.306150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65db4c6-99f5-48c7-a169-c9d79d15077a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.345171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec6971-241c-4b67-ae8c-8a5535dd419a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.381339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c597-a29c-4794-8ca5-c3f54f68235d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.381981 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c597-a29c-4794-8ca5-c3f54f68235d None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.382255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c597-a29c-4794-8ca5-c3f54f68235d None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.382523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c597-a29c-4794-8ca5-c3f54f68235d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.383360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6c597-a29c-4794-8ca5-c3f54f68235d None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=4f6db1c2542943928de6132ec9e61c84) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:22.383668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6c597-a29c-4794-8ca5-c3f54f68235d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:22.385326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6c597-a29c-4794-8ca5-c3f54f68235d None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:22.390409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 292/577] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/role_assignments?user.id=4f6db1c2542943928de6132ec9e61c84&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:22.391201 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c597-a29c-4794-8ca5-c3f54f68235d None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.399227 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65db4c6-99f5-48c7-a169-c9d79d15077a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.444442 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6583bb-772b-4044-9360-e7716efbc01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.445153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6583bb-772b-4044-9360-e7716efbc01e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.445433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6583bb-772b-4044-9360-e7716efbc01e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.445705 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6583bb-772b-4044-9360-e7716efbc01e None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.446466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6583bb-772b-4044-9360-e7716efbc01e None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:22.446773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6583bb-772b-4044-9360-e7716efbc01e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:22.448241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6583bb-772b-4044-9360-e7716efbc01e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:22.457152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 286/578] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:22.458013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6583bb-772b-4044-9360-e7716efbc01e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.512829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c597-a29c-4794-8ca5-c3f54f68235d None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.548556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52909f-e857-40b7-b1f0-508cc2bfc002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.549357 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52909f-e857-40b7-b1f0-508cc2bfc002 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.549634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52909f-e857-40b7-b1f0-508cc2bfc002 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.549902 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52909f-e857-40b7-b1f0-508cc2bfc002 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.557471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52909f-e857-40b7-b1f0-508cc2bfc002 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:22.558953 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52909f-e857-40b7-b1f0-508cc2bfc002 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:22.560649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6583bb-772b-4044-9360-e7716efbc01e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.573626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-1d52909f-e857-40b7-b1f0-508cc2bfc002 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 10:25:22.575000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 293/579] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:22.575669 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52909f-e857-40b7-b1f0-508cc2bfc002 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.595875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237361-5d0c-4352-9a5f-f23624972f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.596665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237361-5d0c-4352-9a5f-f23624972f60 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.596940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237361-5d0c-4352-9a5f-f23624972f60 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.597210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237361-5d0c-4352-9a5f-f23624972f60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.606950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237361-5d0c-4352-9a5f-f23624972f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:22.613804 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-7b237361-5d0c-4352-9a5f-f23624972f60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:22.620395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 287/580] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:22.620395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237361-5d0c-4352-9a5f-f23624972f60 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.672244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52909f-e857-40b7-b1f0-508cc2bfc002 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.704266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a29fb-a8da-4c00-a465-e63d20b35d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.704922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a29fb-a8da-4c00-a465-e63d20b35d17 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.705204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a29fb-a8da-4c00-a465-e63d20b35d17 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.705537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a29fb-a8da-4c00-a465-e63d20b35d17 None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.706313 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a29fb-a8da-4c00-a465-e63d20b35d17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:22.706674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a29fb-a8da-4c00-a465-e63d20b35d17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:22.708130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a29fb-a8da-4c00-a465-e63d20b35d17 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:22.717159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237361-5d0c-4352-9a5f-f23624972f60 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.720392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 294/581] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:22.721198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a29fb-a8da-4c00-a465-e63d20b35d17 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.754856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425724b-6ffb-4867-98d2-9f42221baf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.755664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425724b-6ffb-4867-98d2-9f42221baf6d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.755941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425724b-6ffb-4867-98d2-9f42221baf6d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.756210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425724b-6ffb-4867-98d2-9f42221baf6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.766857 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425724b-6ffb-4867-98d2-9f42221baf6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:22.768268 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425724b-6ffb-4867-98d2-9f42221baf6d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:22.784443 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-f425724b-6ffb-4867-98d2-9f42221baf6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:22.789963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 288/582] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:22.789963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425724b-6ffb-4867-98d2-9f42221baf6d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.822233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a29fb-a8da-4c00-a465-e63d20b35d17 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.855955 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebbb92-2e28-41bf-87a1-ffc64c0f772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.856645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebbb92-2e28-41bf-87a1-ffc64c0f772c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.856891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebbb92-2e28-41bf-87a1-ffc64c0f772c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.857166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebbb92-2e28-41bf-87a1-ffc64c0f772c None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.858395 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebbb92-2e28-41bf-87a1-ffc64c0f772c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:22.858706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebbb92-2e28-41bf-87a1-ffc64c0f772c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:22.861076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebbb92-2e28-41bf-87a1-ffc64c0f772c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:22.878774 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 295/583] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:22.879642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebbb92-2e28-41bf-87a1-ffc64c0f772c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.885924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425724b-6ffb-4867-98d2-9f42221baf6d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.919091 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e72b7-ab9e-4c29-ae17-cedda51c79fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.919745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e72b7-ab9e-4c29-ae17-cedda51c79fa None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.920018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e72b7-ab9e-4c29-ae17-cedda51c79fa None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.920285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e72b7-ab9e-4c29-ae17-cedda51c79fa None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.921004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e72b7-ab9e-4c29-ae17-cedda51c79fa None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:22.921303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e72b7-ab9e-4c29-ae17-cedda51c79fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:22.923175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e72b7-ab9e-4c29-ae17-cedda51c79fa None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:22.930694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 289/584] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:22.931490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e72b7-ab9e-4c29-ae17-cedda51c79fa None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.988292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebbb92-2e28-41bf-87a1-ffc64c0f772c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.020985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81952a8-0ba2-4c4a-93de-0ecc01ad0651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.021776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81952a8-0ba2-4c4a-93de-0ecc01ad0651 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.022064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81952a8-0ba2-4c4a-93de-0ecc01ad0651 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.022322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81952a8-0ba2-4c4a-93de-0ecc01ad0651 None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/b4132c15e66a4a619574f7aba10d6d71/roles/19a2df51b7b646478ee4f4f466082cab` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.027411 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e72b7-ab9e-4c29-ae17-cedda51c79fa None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.037102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81952a8-0ba2-4c4a-93de-0ecc01ad0651 None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=b4132c15e66a4a619574f7aba10d6d71, role_id=19a2df51b7b646478ee4f4f466082cab)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.038519 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81952a8-0ba2-4c4a-93de-0ecc01ad0651 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.059311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 296/585] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:25:22 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/b4132c15e66a4a619574f7aba10d6d71/roles/19a2df51b7b646478ee4f4f466082cab => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:25:23.059311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81952a8-0ba2-4c4a-93de-0ecc01ad0651 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.063365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b3eef-dc04-4947-9ea1-68c9b03c66fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.064044 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b3eef-dc04-4947-9ea1-68c9b03c66fd None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.064324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b3eef-dc04-4947-9ea1-68c9b03c66fd None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.064648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b3eef-dc04-4947-9ea1-68c9b03c66fd None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.065379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b3eef-dc04-4947-9ea1-68c9b03c66fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:23.065682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b3eef-dc04-4947-9ea1-68c9b03c66fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.067120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b3eef-dc04-4947-9ea1-68c9b03c66fd None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.091100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 290/586] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:23.092062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b3eef-dc04-4947-9ea1-68c9b03c66fd None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.167419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81952a8-0ba2-4c4a-93de-0ecc01ad0651 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.200459 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b3eef-dc04-4947-9ea1-68c9b03c66fd None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.210391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c8e4e-63fe-4f66-b171-57561ff5c63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.211605 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8e4e-63fe-4f66-b171-57561ff5c63d None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.211890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8e4e-63fe-4f66-b171-57561ff5c63d None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.212159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8e4e-63fe-4f66-b171-57561ff5c63d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.227253 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c8e4e-63fe-4f66-b171-57561ff5c63d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.229047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c8e4e-63fe-4f66-b171-57561ff5c63d None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.243216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a35fb9-a15b-491d-b8a8-cf9daae5d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.244005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35fb9-a15b-491d-b8a8-cf9daae5d81f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.244278 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35fb9-a15b-491d-b8a8-cf9daae5d81f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.244544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35fb9-a15b-491d-b8a8-cf9daae5d81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.248515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-ad9c8e4e-63fe-4f66-b171-57561ff5c63d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:23.250284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 297/587] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:23.251099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c8e4e-63fe-4f66-b171-57561ff5c63d None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.257451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a35fb9-a15b-491d-b8a8-cf9daae5d81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.258983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a35fb9-a15b-491d-b8a8-cf9daae5d81f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.277920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-06a35fb9-a15b-491d-b8a8-cf9daae5d81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:23.279322 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 291/588] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:23.280221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a35fb9-a15b-491d-b8a8-cf9daae5d81f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.369198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c8e4e-63fe-4f66-b171-57561ff5c63d None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.388698 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a35fb9-a15b-491d-b8a8-cf9daae5d81f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.413009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75819af2-9aad-4ad5-941a-7aa4678648ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.414067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75819af2-9aad-4ad5-941a-7aa4678648ae None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.414353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75819af2-9aad-4ad5-941a-7aa4678648ae None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.414793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75819af2-9aad-4ad5-941a-7aa4678648ae None admin] PATH_INFO: `/v3/users/glance` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.422865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9e5a-1048-4c98-a3a8-700c19358c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.423576 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75819af2-9aad-4ad5-941a-7aa4678648ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.423713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9e5a-1048-4c98-a3a8-700c19358c5f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.424008 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9e5a-1048-4c98-a3a8-700c19358c5f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.424343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9e5a-1048-4c98-a3a8-700c19358c5f None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.425023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75819af2-9aad-4ad5-941a-7aa4678648ae None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.425177 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f9e5a-1048-4c98-a3a8-700c19358c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:23.425526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f9e5a-1048-4c98-a3a8-700c19358c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.426950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f9e5a-1048-4c98-a3a8-700c19358c5f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.439319 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 292/589] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:23.440449 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9e5a-1048-4c98-a3a8-700c19358c5f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.441842 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-75819af2-9aad-4ad5-941a-7aa4678648ae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 10:25:23.443251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 298/590] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:23.449043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75819af2-9aad-4ad5-941a-7aa4678648ae None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.557896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75819af2-9aad-4ad5-941a-7aa4678648ae None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.570656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9e5a-1048-4c98-a3a8-700c19358c5f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.592651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13331e1-35d7-4c42-aa95-9f5e136abce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.594219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13331e1-35d7-4c42-aa95-9f5e136abce9 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.594643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13331e1-35d7-4c42-aa95-9f5e136abce9 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.595094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13331e1-35d7-4c42-aa95-9f5e136abce9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.602052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13331e1-35d7-4c42-aa95-9f5e136abce9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.603659 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13331e1-35d7-4c42-aa95-9f5e136abce9 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.606277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b2dd-f949-4e2e-9cb9-cb727e568274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.607085 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b2dd-f949-4e2e-9cb9-cb727e568274 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.607465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b2dd-f949-4e2e-9cb9-cb727e568274 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.607836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b2dd-f949-4e2e-9cb9-cb727e568274 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.608667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b2dd-f949-4e2e-9cb9-cb727e568274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:23.609117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b2dd-f949-4e2e-9cb9-cb727e568274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.610594 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b2dd-f949-4e2e-9cb9-cb727e568274 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.618619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-b13331e1-35d7-4c42-aa95-9f5e136abce9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:23.620336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 299/591] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:23.621380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13331e1-35d7-4c42-aa95-9f5e136abce9 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.626976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 293/592] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:23.628098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b2dd-f949-4e2e-9cb9-cb727e568274 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.731731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13331e1-35d7-4c42-aa95-9f5e136abce9 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.739381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b2dd-f949-4e2e-9cb9-cb727e568274 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.774436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f7ddb-308a-4bfc-a552-a95658a9e2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.775572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f7ddb-308a-4bfc-a552-a95658a9e2a0 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.775953 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f7ddb-308a-4bfc-a552-a95658a9e2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.776334 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f7ddb-308a-4bfc-a552-a95658a9e2a0 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.777268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f7ddb-308a-4bfc-a552-a95658a9e2a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:23.777686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f7ddb-308a-4bfc-a552-a95658a9e2a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.779236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f7ddb-308a-4bfc-a552-a95658a9e2a0 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.779889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74759fc2-535f-4e24-9b89-ac1467d6674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.780706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74759fc2-535f-4e24-9b89-ac1467d6674e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.782023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74759fc2-535f-4e24-9b89-ac1467d6674e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.782438 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74759fc2-535f-4e24-9b89-ac1467d6674e None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.784681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74759fc2-535f-4e24-9b89-ac1467d6674e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:23.785163 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74759fc2-535f-4e24-9b89-ac1467d6674e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.786716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74759fc2-535f-4e24-9b89-ac1467d6674e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.803919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 300/594] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Feb 28 10:25:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:23.803919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f7ddb-308a-4bfc-a552-a95658a9e2a0 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.804559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 294/594] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:23.805609 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74759fc2-535f-4e24-9b89-ac1467d6674e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.905334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74759fc2-535f-4e24-9b89-ac1467d6674e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.929742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f7ddb-308a-4bfc-a552-a95658a9e2a0 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.939945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be1cd9-4e9b-4f65-8354-498737bd28a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.941011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be1cd9-4e9b-4f65-8354-498737bd28a9 None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.941382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be1cd9-4e9b-4f65-8354-498737bd28a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.941749 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be1cd9-4e9b-4f65-8354-498737bd28a9 None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/e1c59b4bb1774e1badd132071859f503/roles/19a2df51b7b646478ee4f4f466082cab` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.957035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be1cd9-4e9b-4f65-8354-498737bd28a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=e1c59b4bb1774e1badd132071859f503, role_id=19a2df51b7b646478ee4f4f466082cab)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.958713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be1cd9-4e9b-4f65-8354-498737bd28a9 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.973350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f265be-7c54-436d-9356-bfd44ea89f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.974386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f265be-7c54-436d-9356-bfd44ea89f84 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.974559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 295/595] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:25:23 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/e1c59b4bb1774e1badd132071859f503/roles/19a2df51b7b646478ee4f4f466082cab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:25:23.975050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f265be-7c54-436d-9356-bfd44ea89f84 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.975533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f265be-7c54-436d-9356-bfd44ea89f84 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.975726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be1cd9-4e9b-4f65-8354-498737bd28a9 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.994076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f265be-7c54-436d-9356-bfd44ea89f84 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.999136 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f265be-7c54-436d-9356-bfd44ea89f84 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:24.030002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-e6f265be-7c54-436d-9356-bfd44ea89f84 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 10:25:24.032879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 301/596] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:24.040205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f265be-7c54-436d-9356-bfd44ea89f84 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:24.188162 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be1cd9-4e9b-4f65-8354-498737bd28a9 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:24.211421 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f265be-7c54-436d-9356-bfd44ea89f84 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:24.231275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a153233-675a-427f-ae3a-6edf3d2746f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:24.232228 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a153233-675a-427f-ae3a-6edf3d2746f9 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:24.232797 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a153233-675a-427f-ae3a-6edf3d2746f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:24.233074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a153233-675a-427f-ae3a-6edf3d2746f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:24.247818 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a153233-675a-427f-ae3a-6edf3d2746f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:24.249291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a153233-675a-427f-ae3a-6edf3d2746f9 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:24.264177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe4575-27a3-4596-8386-ae26b82622a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:24.264854 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe4575-27a3-4596-8386-ae26b82622a9 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:24.265134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe4575-27a3-4596-8386-ae26b82622a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:24.265492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe4575-27a3-4596-8386-ae26b82622a9 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:24.266815 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe4575-27a3-4596-8386-ae26b82622a9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:24.267142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe4575-27a3-4596-8386-ae26b82622a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:24.268565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe4575-27a3-4596-8386-ae26b82622a9 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:24.285387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-7a153233-675a-427f-ae3a-6edf3d2746f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:24.289037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 296/597] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:24.294387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a153233-675a-427f-ae3a-6edf3d2746f9 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:24.303769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 302/598] 10.222.0.44 () {56 vars in 1139 bytes} [Mon Feb 28 10:25:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:24.309282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe4575-27a3-4596-8386-ae26b82622a9 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:24.487223 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a153233-675a-427f-ae3a-6edf3d2746f9 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:24.487398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe4575-27a3-4596-8386-ae26b82622a9 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:24.529547 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b714dd-597d-40fa-b769-63dced9c1073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:24.530210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b714dd-597d-40fa-b769-63dced9c1073 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:24.530483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b714dd-597d-40fa-b769-63dced9c1073 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:24.530750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b714dd-597d-40fa-b769-63dced9c1073 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:24.531522 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b714dd-597d-40fa-b769-63dced9c1073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:24.531818 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b714dd-597d-40fa-b769-63dced9c1073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:24.533182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b714dd-597d-40fa-b769-63dced9c1073 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:24.549900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 297/599] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:24.551281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b714dd-597d-40fa-b769-63dced9c1073 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:24.568141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097b989-1bca-488d-9bf2-bc0bf3f1bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:24.568980 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097b989-1bca-488d-9bf2-bc0bf3f1bf5b None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:24.569260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097b989-1bca-488d-9bf2-bc0bf3f1bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:24.569532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097b989-1bca-488d-9bf2-bc0bf3f1bf5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:24.587539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097b989-1bca-488d-9bf2-bc0bf3f1bf5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:24.588989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097b989-1bca-488d-9bf2-bc0bf3f1bf5b None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:24.615903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-3097b989-1bca-488d-9bf2-bc0bf3f1bf5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:24.620097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 303/600] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:24.625489 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097b989-1bca-488d-9bf2-bc0bf3f1bf5b None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:24.694822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b714dd-597d-40fa-b769-63dced9c1073 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:24.741323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097b989-1bca-488d-9bf2-bc0bf3f1bf5b None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:24.767038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d19a2-0e9d-4d58-bcd2-4246df40b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:24.768110 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d19a2-0e9d-4d58-bcd2-4246df40b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:24.768387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d19a2-0e9d-4d58-bcd2-4246df40b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:24.768658 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d19a2-0e9d-4d58-bcd2-4246df40b3a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:24.774260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d8c11-e353-4a22-88cf-948c76dbf318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:24.775024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d8c11-e353-4a22-88cf-948c76dbf318 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:24.775387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d8c11-e353-4a22-88cf-948c76dbf318 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:24.775726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d8c11-e353-4a22-88cf-948c76dbf318 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:24.776294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d19a2-0e9d-4d58-bcd2-4246df40b3a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:24.776565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d8c11-e353-4a22-88cf-948c76dbf318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:24.776930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d8c11-e353-4a22-88cf-948c76dbf318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:24.777756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d19a2-0e9d-4d58-bcd2-4246df40b3a4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:24.778556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d8c11-e353-4a22-88cf-948c76dbf318 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:24.791097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 304/601] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:24.792591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9243-730a-4922-a8ce-a597bc2e5bfb None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:24.792939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9243-730a-4922-a8ce-a597bc2e5bfb None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:24.793279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9243-730a-4922-a8ce-a597bc2e5bfb None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:24.795304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 305/602] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:24.797708 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c9243-730a-4922-a8ce-a597bc2e5bfb None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:24.801892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-a87d19a2-0e9d-4d58-bcd2-4246df40b3a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:24.803390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 298/603] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:24.807903 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb292c9-1894-483c-9d22-e454dfe08073 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:24.808186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb292c9-1894-483c-9d22-e454dfe08073 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:24.808453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb292c9-1894-483c-9d22-e454dfe08073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:24.829926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-7fb292c9-1894-483c-9d22-e454dfe08073 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:24.831551 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7fb292c9-1894-483c-9d22-e454dfe08073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:24.906310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c9243-730a-4922-a8ce-a597bc2e5bfb None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:24.923019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 299/604] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:25:24.923885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb292c9-1894-483c-9d22-e454dfe08073 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:24.960677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef84383-066b-4ffd-8d54-2dcf4e47b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:24.962251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef84383-066b-4ffd-8d54-2dcf4e47b4af None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:24.962540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef84383-066b-4ffd-8d54-2dcf4e47b4af None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:24.962982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef84383-066b-4ffd-8d54-2dcf4e47b4af None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:24.972351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef84383-066b-4ffd-8d54-2dcf4e47b4af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:24.974278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef84383-066b-4ffd-8d54-2dcf4e47b4af None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:24.991529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-1ef84383-066b-4ffd-8d54-2dcf4e47b4af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:24.995009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 306/605] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:24.995826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef84383-066b-4ffd-8d54-2dcf4e47b4af None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:25.043628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb292c9-1894-483c-9d22-e454dfe08073 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:25.088453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd315b66-9ce8-4896-b1a9-d1848e2c4881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:25.089234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd315b66-9ce8-4896-b1a9-d1848e2c4881 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.089609 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd315b66-9ce8-4896-b1a9-d1848e2c4881 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.090046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd315b66-9ce8-4896-b1a9-d1848e2c4881 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.090962 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd315b66-9ce8-4896-b1a9-d1848e2c4881 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:25.091383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd315b66-9ce8-4896-b1a9-d1848e2c4881 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:25.093344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd315b66-9ce8-4896-b1a9-d1848e2c4881 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:25.113636 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 300/606] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:25.114665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd315b66-9ce8-4896-b1a9-d1848e2c4881 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:25.121965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef84383-066b-4ffd-8d54-2dcf4e47b4af None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:25.155702 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3d95a-21c2-420c-988f-7fdd619f0864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:25.156563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3d95a-21c2-420c-988f-7fdd619f0864 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.156844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3d95a-21c2-420c-988f-7fdd619f0864 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.157115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3d95a-21c2-420c-988f-7fdd619f0864 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.168030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3d95a-21c2-420c-988f-7fdd619f0864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:25.175619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-35c3d95a-21c2-420c-988f-7fdd619f0864 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:25.181596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 307/607] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:25.182444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3d95a-21c2-420c-988f-7fdd619f0864 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:25.240164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd315b66-9ce8-4896-b1a9-d1848e2c4881 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:25.284121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be11739-6981-4f5a-b323-63b622e0ef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:25.284700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be11739-6981-4f5a-b323-63b622e0ef7a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.284974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be11739-6981-4f5a-b323-63b622e0ef7a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.285241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be11739-6981-4f5a-b323-63b622e0ef7a None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.285407 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3d95a-21c2-420c-988f-7fdd619f0864 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:25.286008 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be11739-6981-4f5a-b323-63b622e0ef7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:25.286306 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be11739-6981-4f5a-b323-63b622e0ef7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:25.288725 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be11739-6981-4f5a-b323-63b622e0ef7a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:25.304291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 301/608] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:25.305529 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be11739-6981-4f5a-b323-63b622e0ef7a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:25.324141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae46e5b-f3f5-4039-98c4-47558fef3ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:25.325078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46e5b-f3f5-4039-98c4-47558fef3ed8 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.325361 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46e5b-f3f5-4039-98c4-47558fef3ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.325692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46e5b-f3f5-4039-98c4-47558fef3ed8 None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/80ad61a348b2450baceb030f98150647/roles/19a2df51b7b646478ee4f4f466082cab` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.343117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae46e5b-f3f5-4039-98c4-47558fef3ed8 None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=80ad61a348b2450baceb030f98150647, role_id=19a2df51b7b646478ee4f4f466082cab)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:25.344714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae46e5b-f3f5-4039-98c4-47558fef3ed8 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:25.369544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 308/609] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:25:25 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/80ad61a348b2450baceb030f98150647/roles/19a2df51b7b646478ee4f4f466082cab => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:25:25.370570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae46e5b-f3f5-4039-98c4-47558fef3ed8 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:25.418981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be11739-6981-4f5a-b323-63b622e0ef7a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:25.454521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e837e-d531-4cad-a5ea-1004baf3dfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:25.455212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e837e-d531-4cad-a5ea-1004baf3dfb8 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.455491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e837e-d531-4cad-a5ea-1004baf3dfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.455758 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e837e-d531-4cad-a5ea-1004baf3dfb8 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.456499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e837e-d531-4cad-a5ea-1004baf3dfb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:25.456795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e837e-d531-4cad-a5ea-1004baf3dfb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:25.458170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e837e-d531-4cad-a5ea-1004baf3dfb8 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:25.467164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 302/610] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:25.483743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e837e-d531-4cad-a5ea-1004baf3dfb8 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:25.501211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae46e5b-f3f5-4039-98c4-47558fef3ed8 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:25.538338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b2aaf-b233-4388-b6eb-8e89656d0d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:25.539244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b2aaf-b233-4388-b6eb-8e89656d0d0d None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.539528 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b2aaf-b233-4388-b6eb-8e89656d0d0d None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.539806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b2aaf-b233-4388-b6eb-8e89656d0d0d None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/44fb3491570c41cbb7271cfce1c31e39/roles/19a2df51b7b646478ee4f4f466082cab` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.556316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b2aaf-b233-4388-b6eb-8e89656d0d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=44fb3491570c41cbb7271cfce1c31e39, role_id=19a2df51b7b646478ee4f4f466082cab)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:25.557774 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b2aaf-b233-4388-b6eb-8e89656d0d0d None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:25.574411 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 309/611] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:25:25 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/44fb3491570c41cbb7271cfce1c31e39/roles/19a2df51b7b646478ee4f4f466082cab => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:25:25.651602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b588e54-b80c-4958-b7e1-8d4d9f81a257 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.651943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b588e54-b80c-4958-b7e1-8d4d9f81a257 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.652161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b588e54-b80c-4958-b7e1-8d4d9f81a257 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.654251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 310/612] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:25.660648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502693d2-0409-4289-9578-241b3de1f08a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.660953 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502693d2-0409-4289-9578-241b3de1f08a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.661203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502693d2-0409-4289-9578-241b3de1f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.675038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e837e-d531-4cad-a5ea-1004baf3dfb8 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:25.694845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-502693d2-0409-4289-9578-241b3de1f08a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:25.695915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-502693d2-0409-4289-9578-241b3de1f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:25.714568 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ccfcb-a7aa-4548-be8f-bd131ec7474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:25.715851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ccfcb-a7aa-4548-be8f-bd131ec7474a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.716336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ccfcb-a7aa-4548-be8f-bd131ec7474a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.717386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ccfcb-a7aa-4548-be8f-bd131ec7474a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.732458 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ccfcb-a7aa-4548-be8f-bd131ec7474a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:25.734606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ccfcb-a7aa-4548-be8f-bd131ec7474a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:25.755140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-797ccfcb-a7aa-4548-be8f-bd131ec7474a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:25.757057 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 303/613] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:25.766084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ccfcb-a7aa-4548-be8f-bd131ec7474a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:25.813428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 311/614] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:25.840807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502693d2-0409-4289-9578-241b3de1f08a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:25.942032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ccfcb-a7aa-4548-be8f-bd131ec7474a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:25.977638 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502693d2-0409-4289-9578-241b3de1f08a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:25.983306 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d1ed1-8267-4ea6-9c50-05aa08540e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:25.984564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d1ed1-8267-4ea6-9c50-05aa08540e01 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.984910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d1ed1-8267-4ea6-9c50-05aa08540e01 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.985252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d1ed1-8267-4ea6-9c50-05aa08540e01 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.986068 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d1ed1-8267-4ea6-9c50-05aa08540e01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:25.986438 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d1ed1-8267-4ea6-9c50-05aa08540e01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:25.988011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d1ed1-8267-4ea6-9c50-05aa08540e01 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:26.005024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 304/615] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:26.010467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d1ed1-8267-4ea6-9c50-05aa08540e01 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:26.020017 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e1de3-709c-4b9d-91d9-11f37b66246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:26.021439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e1de3-709c-4b9d-91d9-11f37b66246b None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:26.021876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e1de3-709c-4b9d-91d9-11f37b66246b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:26.022325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e1de3-709c-4b9d-91d9-11f37b66246b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:26.044757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e1de3-709c-4b9d-91d9-11f37b66246b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:26.052453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-ac7e1de3-709c-4b9d-91d9-11f37b66246b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:26.067300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 312/616] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:26.084863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e1de3-709c-4b9d-91d9-11f37b66246b None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:26.175713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d1ed1-8267-4ea6-9c50-05aa08540e01 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:26.209808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1101d-ee8d-435a-b86f-b66c48a3ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:26.210600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1101d-ee8d-435a-b86f-b66c48a3ecdf None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:26.210877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1101d-ee8d-435a-b86f-b66c48a3ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:26.211200 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1101d-ee8d-435a-b86f-b66c48a3ecdf None admin] PATH_INFO: `/v3/users/swift` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:26.217214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e1de3-709c-4b9d-91d9-11f37b66246b None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:26.219701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1101d-ee8d-435a-b86f-b66c48a3ecdf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:26.221158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1101d-ee8d-435a-b86f-b66c48a3ecdf None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:26.235166 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-4fc1101d-ee8d-435a-b86f-b66c48a3ecdf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:25:26.236697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 305/617] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:26.243860 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1101d-ee8d-435a-b86f-b66c48a3ecdf None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:26.253225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d184-db3d-4131-8b69-f2733911ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:26.253892 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d184-db3d-4131-8b69-f2733911ecea None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:26.254172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d184-db3d-4131-8b69-f2733911ecea None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:26.254444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d184-db3d-4131-8b69-f2733911ecea None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:26.255274 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081d184-db3d-4131-8b69-f2733911ecea None admin] RBAC: Adding query filter params (name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:26.255579 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081d184-db3d-4131-8b69-f2733911ecea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:26.256958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081d184-db3d-4131-8b69-f2733911ecea None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:26.266989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 313/618] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:26.280031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d184-db3d-4131-8b69-f2733911ecea None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:26.364417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1101d-ee8d-435a-b86f-b66c48a3ecdf None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:26.399236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce683479-132c-4548-a8d3-aba83ed87be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:26.399903 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce683479-132c-4548-a8d3-aba83ed87be7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:26.400182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce683479-132c-4548-a8d3-aba83ed87be7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:26.400456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce683479-132c-4548-a8d3-aba83ed87be7 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:26.401279 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce683479-132c-4548-a8d3-aba83ed87be7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:26.401584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce683479-132c-4548-a8d3-aba83ed87be7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:26.403114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce683479-132c-4548-a8d3-aba83ed87be7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:26.421019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 306/619] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Feb 28 10:25:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:26.426309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce683479-132c-4548-a8d3-aba83ed87be7 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:26.487912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d184-db3d-4131-8b69-f2733911ecea None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:26.546876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e79a2-e8db-4d0f-963a-f55fe4aa0116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:26.547678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e79a2-e8db-4d0f-963a-f55fe4aa0116 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:26.547954 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e79a2-e8db-4d0f-963a-f55fe4aa0116 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:26.548220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e79a2-e8db-4d0f-963a-f55fe4aa0116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:26.563775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e79a2-e8db-4d0f-963a-f55fe4aa0116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:26.565229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e79a2-e8db-4d0f-963a-f55fe4aa0116 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:26.579465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce683479-132c-4548-a8d3-aba83ed87be7 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:26.610315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-f01e79a2-e8db-4d0f-963a-f55fe4aa0116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:26.611860 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 314/620] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:26.613554 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07071f2a-24d6-4906-8771-4bd21c2152e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:26.614343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071f2a-24d6-4906-8771-4bd21c2152e8 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:26.614666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071f2a-24d6-4906-8771-4bd21c2152e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:26.614883 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071f2a-24d6-4906-8771-4bd21c2152e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:26.619885 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e79a2-e8db-4d0f-963a-f55fe4aa0116 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:26.626210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07071f2a-24d6-4906-8771-4bd21c2152e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:26.627838 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07071f2a-24d6-4906-8771-4bd21c2152e8 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:26.653410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-07071f2a-24d6-4906-8771-4bd21c2152e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:26.659941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 307/621] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:26.665400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07071f2a-24d6-4906-8771-4bd21c2152e8 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:26.740118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e79a2-e8db-4d0f-963a-f55fe4aa0116 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:26.778801 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15271fb-6712-499d-9fa2-6a34c3716805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:26.779783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15271fb-6712-499d-9fa2-6a34c3716805 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:26.780073 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15271fb-6712-499d-9fa2-6a34c3716805 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:26.780352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15271fb-6712-499d-9fa2-6a34c3716805 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:26.781790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15271fb-6712-499d-9fa2-6a34c3716805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:26.782423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15271fb-6712-499d-9fa2-6a34c3716805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:26.784114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15271fb-6712-499d-9fa2-6a34c3716805 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:26.803124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 315/622] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:26.804715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f5e6-8327-46e4-bce0-9f9221975688 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:26.806963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f5e6-8327-46e4-bce0-9f9221975688 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:26.807259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f5e6-8327-46e4-bce0-9f9221975688 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:26.809149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 316/623] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:26.813216 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657f5e6-8327-46e4-bce0-9f9221975688 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:26.839562 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07071f2a-24d6-4906-8771-4bd21c2152e8 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:26.874524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbd63f-3e55-4f6e-b1e3-21ace3b1e190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:26.875572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbd63f-3e55-4f6e-b1e3-21ace3b1e190 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:26.876053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbd63f-3e55-4f6e-b1e3-21ace3b1e190 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:26.876559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbd63f-3e55-4f6e-b1e3-21ace3b1e190 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:26.877525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbd63f-3e55-4f6e-b1e3-21ace3b1e190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:26.878070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbd63f-3e55-4f6e-b1e3-21ace3b1e190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:26.879665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbd63f-3e55-4f6e-b1e3-21ace3b1e190 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:26.892877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 308/624] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:26.894616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47641ee-01ea-4aee-9fdb-bf2e78260d33 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:26.895143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47641ee-01ea-4aee-9fdb-bf2e78260d33 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:26.895621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47641ee-01ea-4aee-9fdb-bf2e78260d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:26.912629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a47641ee-01ea-4aee-9fdb-bf2e78260d33 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:26.914116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a47641ee-01ea-4aee-9fdb-bf2e78260d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:26.914640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657f5e6-8327-46e4-bce0-9f9221975688 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:26.948654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13df160-88f5-41d2-af4a-d0422ae54f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:26.949436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13df160-88f5-41d2-af4a-d0422ae54f70 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:26.949813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13df160-88f5-41d2-af4a-d0422ae54f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:26.949989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13df160-88f5-41d2-af4a-d0422ae54f70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:26.957699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13df160-88f5-41d2-af4a-d0422ae54f70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:26.959543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13df160-88f5-41d2-af4a-d0422ae54f70 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:26.974715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-e13df160-88f5-41d2-af4a-d0422ae54f70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:25:26.980695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 317/625] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Feb 28 10:25:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:26.980695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13df160-88f5-41d2-af4a-d0422ae54f70 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:26.999146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 309/626] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:27.001202 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47641ee-01ea-4aee-9fdb-bf2e78260d33 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:27.094087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13df160-88f5-41d2-af4a-d0422ae54f70 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:27.118097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47641ee-01ea-4aee-9fdb-bf2e78260d33 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:27.127858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04e67b-0439-4a64-92ac-3b7090718667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:27.128661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04e67b-0439-4a64-92ac-3b7090718667 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.129013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04e67b-0439-4a64-92ac-3b7090718667 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.129369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04e67b-0439-4a64-92ac-3b7090718667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.137754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04e67b-0439-4a64-92ac-3b7090718667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:27.139300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04e67b-0439-4a64-92ac-3b7090718667 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:27.153767 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-9f04e67b-0439-4a64-92ac-3b7090718667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:27.153882 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73823838-3281-4c3a-94ef-7a3bb26d1800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:27.154501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73823838-3281-4c3a-94ef-7a3bb26d1800 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.154780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73823838-3281-4c3a-94ef-7a3bb26d1800 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.155094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73823838-3281-4c3a-94ef-7a3bb26d1800 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.155479 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 318/627] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:27.156284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04e67b-0439-4a64-92ac-3b7090718667 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:27.156453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73823838-3281-4c3a-94ef-7a3bb26d1800 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:27.156648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73823838-3281-4c3a-94ef-7a3bb26d1800 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:27.158246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73823838-3281-4c3a-94ef-7a3bb26d1800 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:27.181166 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 310/628] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Feb 28 10:25:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:27.181915 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73823838-3281-4c3a-94ef-7a3bb26d1800 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:27.253634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04e67b-0439-4a64-92ac-3b7090718667 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:27.281594 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73823838-3281-4c3a-94ef-7a3bb26d1800 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:27.287139 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524bff-4c43-49dd-9bae-4d4604aa4c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:27.287918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524bff-4c43-49dd-9bae-4d4604aa4c0f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.288192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524bff-4c43-49dd-9bae-4d4604aa4c0f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.288462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524bff-4c43-49dd-9bae-4d4604aa4c0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.298676 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9524bff-4c43-49dd-9bae-4d4604aa4c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:27.305719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-c9524bff-4c43-49dd-9bae-4d4604aa4c0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:27.307260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 319/629] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:27.308103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524bff-4c43-49dd-9bae-4d4604aa4c0f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:27.321340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57c67f-5d86-47f5-8d20-8e1bb686b841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:27.321999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57c67f-5d86-47f5-8d20-8e1bb686b841 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.322285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57c67f-5d86-47f5-8d20-8e1bb686b841 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.322579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57c67f-5d86-47f5-8d20-8e1bb686b841 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.323513 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57c67f-5d86-47f5-8d20-8e1bb686b841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:27.323851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57c67f-5d86-47f5-8d20-8e1bb686b841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:27.325383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57c67f-5d86-47f5-8d20-8e1bb686b841 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:27.338186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 311/630] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:27.339138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57c67f-5d86-47f5-8d20-8e1bb686b841 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:27.412132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524bff-4c43-49dd-9bae-4d4604aa4c0f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:27.439657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57c67f-5d86-47f5-8d20-8e1bb686b841 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:27.445303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83d357-5b31-4796-86fd-a69b30a15669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:27.445950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83d357-5b31-4796-86fd-a69b30a15669 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.446227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83d357-5b31-4796-86fd-a69b30a15669 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.446498 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83d357-5b31-4796-86fd-a69b30a15669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.474075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25851fc2-ca5f-4e83-96ee-8368c1e57f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:27.474747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25851fc2-ca5f-4e83-96ee-8368c1e57f00 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.475101 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25851fc2-ca5f-4e83-96ee-8368c1e57f00 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.475376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25851fc2-ca5f-4e83-96ee-8368c1e57f00 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.476167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25851fc2-ca5f-4e83-96ee-8368c1e57f00 None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:27.476471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25851fc2-ca5f-4e83-96ee-8368c1e57f00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:27.477848 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25851fc2-ca5f-4e83-96ee-8368c1e57f00 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:27.491310 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 312/631] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:27.492203 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25851fc2-ca5f-4e83-96ee-8368c1e57f00 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:27.516298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83d357-5b31-4796-86fd-a69b30a15669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:27.517736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83d357-5b31-4796-86fd-a69b30a15669 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:27.593719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25851fc2-ca5f-4e83-96ee-8368c1e57f00 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:27.617282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 320/632] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:27.618482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83d357-5b31-4796-86fd-a69b30a15669 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:27.631987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5fb31-5df2-4b47-8690-062f2d9d1388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:27.633251 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5fb31-5df2-4b47-8690-062f2d9d1388 None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.633736 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5fb31-5df2-4b47-8690-062f2d9d1388 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.634209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5fb31-5df2-4b47-8690-062f2d9d1388 None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/4f6db1c2542943928de6132ec9e61c84/roles/19a2df51b7b646478ee4f4f466082cab` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.650003 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5fb31-5df2-4b47-8690-062f2d9d1388 None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=4f6db1c2542943928de6132ec9e61c84, role_id=19a2df51b7b646478ee4f4f466082cab)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:27.651843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5fb31-5df2-4b47-8690-062f2d9d1388 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:27.667482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 313/633] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:25:27 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/4f6db1c2542943928de6132ec9e61c84/roles/19a2df51b7b646478ee4f4f466082cab => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:25:27.668784 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5fb31-5df2-4b47-8690-062f2d9d1388 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:27.723329 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83d357-5b31-4796-86fd-a69b30a15669 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:27.759083 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4378b-6371-4967-ac28-1fcc462d2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:27.759871 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4378b-6371-4967-ac28-1fcc462d2e0c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.760403 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4378b-6371-4967-ac28-1fcc462d2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.760680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4378b-6371-4967-ac28-1fcc462d2e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.771258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4378b-6371-4967-ac28-1fcc462d2e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:27.772733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4378b-6371-4967-ac28-1fcc462d2e0c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:27.779788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5fb31-5df2-4b47-8690-062f2d9d1388 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:27.791508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-a9c4378b-6371-4967-ac28-1fcc462d2e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:27.793149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 321/634] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:27.802206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4378b-6371-4967-ac28-1fcc462d2e0c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:27.825800 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe3afa-06f2-408e-aa87-d30033d62da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:27.827058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe3afa-06f2-408e-aa87-d30033d62da2 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.827556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe3afa-06f2-408e-aa87-d30033d62da2 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.828071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe3afa-06f2-408e-aa87-d30033d62da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.839744 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe3afa-06f2-408e-aa87-d30033d62da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:27.841662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe3afa-06f2-408e-aa87-d30033d62da2 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:27.860584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-25fe3afa-06f2-408e-aa87-d30033d62da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:27.862569 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 314/635] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:27.868537 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe3afa-06f2-408e-aa87-d30033d62da2 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:27.923455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4378b-6371-4967-ac28-1fcc462d2e0c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:27.966790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742feb1-3437-460c-a936-9fa0fe4af63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:27.968022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742feb1-3437-460c-a936-9fa0fe4af63f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.968896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742feb1-3437-460c-a936-9fa0fe4af63f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.969635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742feb1-3437-460c-a936-9fa0fe4af63f None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.970762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742feb1-3437-460c-a936-9fa0fe4af63f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:27.971653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742feb1-3437-460c-a936-9fa0fe4af63f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:27.973401 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742feb1-3437-460c-a936-9fa0fe4af63f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:27.986547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 322/636] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:27.993172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742feb1-3437-460c-a936-9fa0fe4af63f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:28.054348 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe3afa-06f2-408e-aa87-d30033d62da2 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:28.096293 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4cbd8-fd33-4ec4-a524-1ab7c61ffbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:28.097194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4cbd8-fd33-4ec4-a524-1ab7c61ffbd7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.097646 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4cbd8-fd33-4ec4-a524-1ab7c61ffbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.098087 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4cbd8-fd33-4ec4-a524-1ab7c61ffbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.099015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4cbd8-fd33-4ec4-a524-1ab7c61ffbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:28.099492 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4cbd8-fd33-4ec4-a524-1ab7c61ffbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:28.101038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4cbd8-fd33-4ec4-a524-1ab7c61ffbd7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:28.113391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 315/637] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:28.115109 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56ec1-e1fe-4660-8278-344856d3aacb None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.115621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56ec1-e1fe-4660-8278-344856d3aacb None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.116087 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56ec1-e1fe-4660-8278-344856d3aacb None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.116841 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742feb1-3437-460c-a936-9fa0fe4af63f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:28.118857 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 316/638] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:28.119847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56ec1-e1fe-4660-8278-344856d3aacb None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:28.160810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c856f-d933-4dde-a2ff-61b2813d283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:28.161656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c856f-d933-4dde-a2ff-61b2813d283b None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.161947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c856f-d933-4dde-a2ff-61b2813d283b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.162223 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c856f-d933-4dde-a2ff-61b2813d283b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.174516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c856f-d933-4dde-a2ff-61b2813d283b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:28.175939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c856f-d933-4dde-a2ff-61b2813d283b None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:28.190084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-673c856f-d933-4dde-a2ff-61b2813d283b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 10:25:28.195952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 323/639] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:28.195952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da2e4f-e21c-4878-8202-352fa4aed699 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.195952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da2e4f-e21c-4878-8202-352fa4aed699 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.195952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da2e4f-e21c-4878-8202-352fa4aed699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.210424 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f2da2e4f-e21c-4878-8202-352fa4aed699 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:28.211673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f2da2e4f-e21c-4878-8202-352fa4aed699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:28.244810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56ec1-e1fe-4660-8278-344856d3aacb None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:28.287194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7f060-6629-4731-ae8f-86813b95f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:28.288500 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f060-6629-4731-ae8f-86813b95f301 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.288761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 324/640] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:28.289191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f060-6629-4731-ae8f-86813b95f301 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.289674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da2e4f-e21c-4878-8202-352fa4aed699 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:28.289884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f060-6629-4731-ae8f-86813b95f301 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.299196 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7f060-6629-4731-ae8f-86813b95f301 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:28.301629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7f060-6629-4731-ae8f-86813b95f301 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:28.326939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-86e7f060-6629-4731-ae8f-86813b95f301 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:28.328685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 317/641] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:28.329547 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7f060-6629-4731-ae8f-86813b95f301 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:28.415118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da2e4f-e21c-4878-8202-352fa4aed699 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:28.427232 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7f060-6629-4731-ae8f-86813b95f301 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:28.449490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f5ab-6524-414b-b9c8-08df9a30fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:28.450220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f5ab-6524-414b-b9c8-08df9a30fff2 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.450414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f5ab-6524-414b-b9c8-08df9a30fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.450681 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f5ab-6524-414b-b9c8-08df9a30fff2 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.451532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f5ab-6524-414b-b9c8-08df9a30fff2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:28.451835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f5ab-6524-414b-b9c8-08df9a30fff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:28.453282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f5ab-6524-414b-b9c8-08df9a30fff2 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:28.461121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d9b16-cd6b-46b6-a35e-580f627e473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:28.461902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d9b16-cd6b-46b6-a35e-580f627e473e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.462188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d9b16-cd6b-46b6-a35e-580f627e473e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.462459 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d9b16-cd6b-46b6-a35e-580f627e473e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.470014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 325/642] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Feb 28 10:25:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:28.470014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f5ab-6524-414b-b9c8-08df9a30fff2 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:28.475892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d9b16-cd6b-46b6-a35e-580f627e473e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:28.482747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-9b5d9b16-cd6b-46b6-a35e-580f627e473e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:28.484666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 318/643] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:28.489544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996832f0-eafb-4202-931e-c54beb5930d9 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.489544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996832f0-eafb-4202-931e-c54beb5930d9 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.489544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996832f0-eafb-4202-931e-c54beb5930d9 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.489544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 319/644] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:28.489544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996832f0-eafb-4202-931e-c54beb5930d9 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:28.574663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f5ab-6524-414b-b9c8-08df9a30fff2 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:28.587946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996832f0-eafb-4202-931e-c54beb5930d9 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:28.611757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b1783-41d2-441a-90e6-f35633ce4269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:28.612407 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b1783-41d2-441a-90e6-f35633ce4269 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.612684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b1783-41d2-441a-90e6-f35633ce4269 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.612954 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b1783-41d2-441a-90e6-f35633ce4269 None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.613722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b1783-41d2-441a-90e6-f35633ce4269 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:28.614026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b1783-41d2-441a-90e6-f35633ce4269 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:28.615465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b1783-41d2-441a-90e6-f35633ce4269 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:28.620602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706a02e-d862-44d7-b464-271ebc672a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:28.621248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706a02e-d862-44d7-b464-271ebc672a08 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.622098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706a02e-d862-44d7-b464-271ebc672a08 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.622098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706a02e-d862-44d7-b464-271ebc672a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.628267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 326/645] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:28.629156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b1783-41d2-441a-90e6-f35633ce4269 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:28.687951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706a02e-d862-44d7-b464-271ebc672a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:28.689326 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706a02e-d862-44d7-b464-271ebc672a08 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:28.732341 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b1783-41d2-441a-90e6-f35633ce4269 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:28.765142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4884d-d892-4ae2-ab91-a3761de04d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:28.765850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4884d-d892-4ae2-ab91-a3761de04d06 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.766136 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4884d-d892-4ae2-ab91-a3761de04d06 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.766412 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4884d-d892-4ae2-ab91-a3761de04d06 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.767174 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4884d-d892-4ae2-ab91-a3761de04d06 None admin] RBAC: Adding query filter params (name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:28.767484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4884d-d892-4ae2-ab91-a3761de04d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:28.768901 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4884d-d892-4ae2-ab91-a3761de04d06 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:28.781858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 327/646] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:28.781858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af1d8-0e29-4c08-beac-c6daf38b70f7 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.781858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af1d8-0e29-4c08-beac-c6daf38b70f7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.781858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af1d8-0e29-4c08-beac-c6daf38b70f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.786812 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 320/647] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:28.787873 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706a02e-d862-44d7-b464-271ebc672a08 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:28.797104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-351af1d8-0e29-4c08-beac-c6daf38b70f7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:28.798267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-351af1d8-0e29-4c08-beac-c6daf38b70f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:28.870924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 328/648] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:28.870924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af1d8-0e29-4c08-beac-c6daf38b70f7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:28.896281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706a02e-d862-44d7-b464-271ebc672a08 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:28.929599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d7dfb-2f1f-4267-951e-2806bbeccbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:28.930242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d7dfb-2f1f-4267-951e-2806bbeccbe4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:28.930515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d7dfb-2f1f-4267-951e-2806bbeccbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:28.930780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d7dfb-2f1f-4267-951e-2806bbeccbe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:28.931643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d7dfb-2f1f-4267-951e-2806bbeccbe4 None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=b4132c15e66a4a619574f7aba10d6d71) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:28.931923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d7dfb-2f1f-4267-951e-2806bbeccbe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:28.933331 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d7dfb-2f1f-4267-951e-2806bbeccbe4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:28.939701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 321/649] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:28 2022] GET /identity/v3/role_assignments?user.id=b4132c15e66a4a619574f7aba10d6d71&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:28.940433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d7dfb-2f1f-4267-951e-2806bbeccbe4 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:28.985826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af1d8-0e29-4c08-beac-c6daf38b70f7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.023505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c76bd0-dc59-4a30-8aef-55747aa5eecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:29.025151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c76bd0-dc59-4a30-8aef-55747aa5eecd None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:29.025706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c76bd0-dc59-4a30-8aef-55747aa5eecd None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:29.026208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c76bd0-dc59-4a30-8aef-55747aa5eecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:29.037835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c76bd0-dc59-4a30-8aef-55747aa5eecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:29.039709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c76bd0-dc59-4a30-8aef-55747aa5eecd None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:29.054207 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d7dfb-2f1f-4267-951e-2806bbeccbe4 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.059033 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-39c76bd0-dc59-4a30-8aef-55747aa5eecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:29.060879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 329/650] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:29.062619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c76bd0-dc59-4a30-8aef-55747aa5eecd None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:29.099082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8d3c2-53f5-44c3-a041-80f0bfb26a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:29.099939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8d3c2-53f5-44c3-a041-80f0bfb26a5c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:29.100209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8d3c2-53f5-44c3-a041-80f0bfb26a5c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:29.100475 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8d3c2-53f5-44c3-a041-80f0bfb26a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:29.112422 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8d3c2-53f5-44c3-a041-80f0bfb26a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:29.114070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8d3c2-53f5-44c3-a041-80f0bfb26a5c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:29.133287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e5a8d3c2-53f5-44c3-a041-80f0bfb26a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:29.138947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 322/651] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:29.138947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8d3c2-53f5-44c3-a041-80f0bfb26a5c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:29.194790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c76bd0-dc59-4a30-8aef-55747aa5eecd None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.238377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ba486-3516-4099-9f9f-54c1aa0562f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:29.239200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba486-3516-4099-9f9f-54c1aa0562f6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:29.239481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba486-3516-4099-9f9f-54c1aa0562f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:29.239755 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba486-3516-4099-9f9f-54c1aa0562f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:29.254004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ba486-3516-4099-9f9f-54c1aa0562f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:29.263476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-0c7ba486-3516-4099-9f9f-54c1aa0562f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:29.263593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8d3c2-53f5-44c3-a041-80f0bfb26a5c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.264885 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 330/652] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:29.265667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ba486-3516-4099-9f9f-54c1aa0562f6 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:29.308865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee8e6f-5417-4f7c-a9c7-00cfa9e817d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:29.309942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8e6f-5417-4f7c-a9c7-00cfa9e817d4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:29.310276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8e6f-5417-4f7c-a9c7-00cfa9e817d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:29.310555 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8e6f-5417-4f7c-a9c7-00cfa9e817d4 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:29.311574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee8e6f-5417-4f7c-a9c7-00cfa9e817d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:29.311885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee8e6f-5417-4f7c-a9c7-00cfa9e817d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:29.313795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee8e6f-5417-4f7c-a9c7-00cfa9e817d4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:29.329570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 323/653] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:29.330461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee8e6f-5417-4f7c-a9c7-00cfa9e817d4 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:29.387794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ba486-3516-4099-9f9f-54c1aa0562f6 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.433074 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bc484-4c81-4310-9e68-b11f831fee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:29.433730 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bc484-4c81-4310-9e68-b11f831fee1e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:29.434009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bc484-4c81-4310-9e68-b11f831fee1e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:29.434278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bc484-4c81-4310-9e68-b11f831fee1e None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:29.435013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bc484-4c81-4310-9e68-b11f831fee1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:29.435318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bc484-4c81-4310-9e68-b11f831fee1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:29.436677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bc484-4c81-4310-9e68-b11f831fee1e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:29.437490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee8e6f-5417-4f7c-a9c7-00cfa9e817d4 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.453782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 331/654] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:29.453782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bc484-4c81-4310-9e68-b11f831fee1e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:29.487965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493cb41-042a-400d-bc3a-bd51956ec461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:29.489693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493cb41-042a-400d-bc3a-bd51956ec461 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:29.490183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493cb41-042a-400d-bc3a-bd51956ec461 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:29.490875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493cb41-042a-400d-bc3a-bd51956ec461 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:29.491849 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493cb41-042a-400d-bc3a-bd51956ec461 None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:29.492370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493cb41-042a-400d-bc3a-bd51956ec461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:29.494361 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493cb41-042a-400d-bc3a-bd51956ec461 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:29.505172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 324/655] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:29.506770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493cb41-042a-400d-bc3a-bd51956ec461 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:29.553621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bc484-4c81-4310-9e68-b11f831fee1e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.588032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1b00c-9e6b-4086-a0b2-5fd1e028dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:29.588560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1b00c-9e6b-4086-a0b2-5fd1e028dd7c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:29.588840 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1b00c-9e6b-4086-a0b2-5fd1e028dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:29.589113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1b00c-9e6b-4086-a0b2-5fd1e028dd7c None admin] PATH_INFO: `/v3/users/glance` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:29.597015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1b00c-9e6b-4086-a0b2-5fd1e028dd7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:29.598457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1b00c-9e6b-4086-a0b2-5fd1e028dd7c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:29.612411 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-bda1b00c-9e6b-4086-a0b2-5fd1e028dd7c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 10:25:29.613015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493cb41-042a-400d-bc3a-bd51956ec461 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.618226 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 332/656] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:29.619124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1b00c-9e6b-4086-a0b2-5fd1e028dd7c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:29.649304 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f59c-aece-474b-9f4f-203367889410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:29.650449 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f59c-aece-474b-9f4f-203367889410 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:29.650950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f59c-aece-474b-9f4f-203367889410 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:29.651460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f59c-aece-474b-9f4f-203367889410 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:29.658352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5f59c-aece-474b-9f4f-203367889410 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:29.660035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5f59c-aece-474b-9f4f-203367889410 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:29.674646 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-6cb5f59c-aece-474b-9f4f-203367889410 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:29.680884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 325/657] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:29.682019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f59c-aece-474b-9f4f-203367889410 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:29.720833 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1b00c-9e6b-4086-a0b2-5fd1e028dd7c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.755266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f3938-f8e2-4601-976a-4cdaf9ba1552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:29.756654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f3938-f8e2-4601-976a-4cdaf9ba1552 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:29.756654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f3938-f8e2-4601-976a-4cdaf9ba1552 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:29.756852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f3938-f8e2-4601-976a-4cdaf9ba1552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:29.768102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f3938-f8e2-4601-976a-4cdaf9ba1552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:29.769572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f3938-f8e2-4601-976a-4cdaf9ba1552 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:29.787487 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-d35f3938-f8e2-4601-976a-4cdaf9ba1552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:29.789109 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 333/658] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:29.789487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f59c-aece-474b-9f4f-203367889410 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.790024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f3938-f8e2-4601-976a-4cdaf9ba1552 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:29.828125 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f96a9a-3036-4bce-96d0-7e328b91a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:29.829191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f96a9a-3036-4bce-96d0-7e328b91a39b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:29.829675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f96a9a-3036-4bce-96d0-7e328b91a39b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:29.830390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f96a9a-3036-4bce-96d0-7e328b91a39b None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:29.831449 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f96a9a-3036-4bce-96d0-7e328b91a39b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:29.831962 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f96a9a-3036-4bce-96d0-7e328b91a39b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:29.833596 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f96a9a-3036-4bce-96d0-7e328b91a39b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:29.851393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 326/659] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Feb 28 10:25:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:29.852570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f96a9a-3036-4bce-96d0-7e328b91a39b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:29.904876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f3938-f8e2-4601-976a-4cdaf9ba1552 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.940333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abe4bb-2364-4f54-8ca2-2b52283a1d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:29.941339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abe4bb-2364-4f54-8ca2-2b52283a1d05 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:29.941824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abe4bb-2364-4f54-8ca2-2b52283a1d05 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:29.942325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abe4bb-2364-4f54-8ca2-2b52283a1d05 None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:29.943344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abe4bb-2364-4f54-8ca2-2b52283a1d05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:29.943856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abe4bb-2364-4f54-8ca2-2b52283a1d05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:29.945537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abe4bb-2364-4f54-8ca2-2b52283a1d05 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:29.963057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 334/660] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:29.963765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f96a9a-3036-4bce-96d0-7e328b91a39b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:29.964597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abe4bb-2364-4f54-8ca2-2b52283a1d05 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:30.008987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3e7f2-d00d-42a1-8d91-f526219649b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:30.009588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e7f2-d00d-42a1-8d91-f526219649b4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.009865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e7f2-d00d-42a1-8d91-f526219649b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.010385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e7f2-d00d-42a1-8d91-f526219649b4 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.011571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3e7f2-d00d-42a1-8d91-f526219649b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:30.011884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3e7f2-d00d-42a1-8d91-f526219649b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:30.013247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3e7f2-d00d-42a1-8d91-f526219649b4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:30.027815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 327/661] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:30.028971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3e7f2-d00d-42a1-8d91-f526219649b4 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:30.072626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abe4bb-2364-4f54-8ca2-2b52283a1d05 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:30.120157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5644c11-a1da-44c2-aa6b-52e7fc9d0022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:30.121167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644c11-a1da-44c2-aa6b-52e7fc9d0022 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.121679 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644c11-a1da-44c2-aa6b-52e7fc9d0022 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.122162 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644c11-a1da-44c2-aa6b-52e7fc9d0022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.149645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3e7f2-d00d-42a1-8d91-f526219649b4 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:30.181399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d2f41-35af-44cc-88af-f65f792210c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:30.182055 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d2f41-35af-44cc-88af-f65f792210c6 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.182334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d2f41-35af-44cc-88af-f65f792210c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.182605 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d2f41-35af-44cc-88af-f65f792210c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.183445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d2f41-35af-44cc-88af-f65f792210c6 None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=e1c59b4bb1774e1badd132071859f503) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:30.183759 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d2f41-35af-44cc-88af-f65f792210c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:30.185254 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d2f41-35af-44cc-88af-f65f792210c6 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:30.195187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 328/662] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:30 2022] GET /identity/v3/role_assignments?user.id=e1c59b4bb1774e1badd132071859f503&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:30.195187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d2f41-35af-44cc-88af-f65f792210c6 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:30.198771 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5644c11-a1da-44c2-aa6b-52e7fc9d0022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:30.200345 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5644c11-a1da-44c2-aa6b-52e7fc9d0022 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:30.311525 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 335/663] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:30.313616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285152ce-81e6-4677-930e-6c1331572b2b None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.313934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285152ce-81e6-4677-930e-6c1331572b2b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.314225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285152ce-81e6-4677-930e-6c1331572b2b None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.316184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 336/664] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:30.317823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285152ce-81e6-4677-930e-6c1331572b2b None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:30.335159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d2f41-35af-44cc-88af-f65f792210c6 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:30.380030 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e658b-1f89-458a-9f03-2f316d47526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:30.381879 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e658b-1f89-458a-9f03-2f316d47526f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.382374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e658b-1f89-458a-9f03-2f316d47526f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.383072 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e658b-1f89-458a-9f03-2f316d47526f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.394711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e658b-1f89-458a-9f03-2f316d47526f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:30.396193 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e658b-1f89-458a-9f03-2f316d47526f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:30.415378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-445e658b-1f89-458a-9f03-2f316d47526f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 10:25:30.417599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 329/665] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:30.419543 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803a2a-9b80-4057-9c7f-da3b277ee559 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.419828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803a2a-9b80-4057-9c7f-da3b277ee559 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.420386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803a2a-9b80-4057-9c7f-da3b277ee559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.436120 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285152ce-81e6-4677-930e-6c1331572b2b None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:30.440411 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0f803a2a-9b80-4057-9c7f-da3b277ee559 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:30.441593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0f803a2a-9b80-4057-9c7f-da3b277ee559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:30.479362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a114a9-aae2-45fe-ab16-0f9f8ce456c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:30.480158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a114a9-aae2-45fe-ab16-0f9f8ce456c5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.480443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a114a9-aae2-45fe-ab16-0f9f8ce456c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.480719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a114a9-aae2-45fe-ab16-0f9f8ce456c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.496157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a114a9-aae2-45fe-ab16-0f9f8ce456c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:30.498648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a114a9-aae2-45fe-ab16-0f9f8ce456c5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:30.517859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 330/666] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:30.518831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f803a2a-9b80-4057-9c7f-da3b277ee559 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:30.520806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-50a114a9-aae2-45fe-ab16-0f9f8ce456c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:30.522381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 337/667] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:30.528158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a114a9-aae2-45fe-ab16-0f9f8ce456c5 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:30.634669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f803a2a-9b80-4057-9c7f-da3b277ee559 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:30.659868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a114a9-aae2-45fe-ab16-0f9f8ce456c5 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:30.669575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7e00b-c898-45f9-a853-9a8520c9bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:30.670239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7e00b-c898-45f9-a853-9a8520c9bd78 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.670510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7e00b-c898-45f9-a853-9a8520c9bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.670776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7e00b-c898-45f9-a853-9a8520c9bd78 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.672158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7e00b-c898-45f9-a853-9a8520c9bd78 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:30.672457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7e00b-c898-45f9-a853-9a8520c9bd78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:30.673886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7e00b-c898-45f9-a853-9a8520c9bd78 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:30.691611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 331/668] 10.222.0.44 () {56 vars in 1139 bytes} [Mon Feb 28 10:25:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:30.694781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3203328-f32c-42a0-9cf8-a94033d62888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:30.695627 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3203328-f32c-42a0-9cf8-a94033d62888 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.696053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3203328-f32c-42a0-9cf8-a94033d62888 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.696492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3203328-f32c-42a0-9cf8-a94033d62888 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.696709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7e00b-c898-45f9-a853-9a8520c9bd78 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:30.697796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3203328-f32c-42a0-9cf8-a94033d62888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:30.698262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3203328-f32c-42a0-9cf8-a94033d62888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:30.699855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3203328-f32c-42a0-9cf8-a94033d62888 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:30.712283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 338/669] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:30.713391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3203328-f32c-42a0-9cf8-a94033d62888 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:30.794926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7e00b-c898-45f9-a853-9a8520c9bd78 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:30.814233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3203328-f32c-42a0-9cf8-a94033d62888 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:30.830343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0f01e-f579-41a7-a7f0-885a1f216fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:30.831388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f01e-f579-41a7-a7f0-885a1f216fe7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.831662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f01e-f579-41a7-a7f0-885a1f216fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.831929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f01e-f579-41a7-a7f0-885a1f216fe7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.841922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0f01e-f579-41a7-a7f0-885a1f216fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:30.849301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-a3f0f01e-f579-41a7-a7f0-885a1f216fe7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:30.849844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bade2b1-839d-4835-b7a6-6707fbcb4eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:30.854993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bade2b1-839d-4835-b7a6-6707fbcb4eec None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.855130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 332/670] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:30.855130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0f01e-f579-41a7-a7f0-885a1f216fe7 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:30.855800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bade2b1-839d-4835-b7a6-6707fbcb4eec None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.856281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bade2b1-839d-4835-b7a6-6707fbcb4eec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.926066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bade2b1-839d-4835-b7a6-6707fbcb4eec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:30.927870 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bade2b1-839d-4835-b7a6-6707fbcb4eec None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:30.951102 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0f01e-f579-41a7-a7f0-885a1f216fe7 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:30.985959 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d530d9d-c589-4374-a63f-a218f5f98420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:30.986748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530d9d-c589-4374-a63f-a218f5f98420 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.987066 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530d9d-c589-4374-a63f-a218f5f98420 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.987334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530d9d-c589-4374-a63f-a218f5f98420 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.994018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d530d9d-c589-4374-a63f-a218f5f98420 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:30.995520 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d530d9d-c589-4374-a63f-a218f5f98420 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:31.012974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-4d530d9d-c589-4374-a63f-a218f5f98420 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:31.014933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 333/671] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:31.015891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d530d9d-c589-4374-a63f-a218f5f98420 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:31.032403 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 339/672] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:31.033648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bade2b1-839d-4835-b7a6-6707fbcb4eec None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:31.147004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bade2b1-839d-4835-b7a6-6707fbcb4eec None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:31.152355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d530d9d-c589-4374-a63f-a218f5f98420 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:31.182084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bf737-0fb6-4f12-b12e-02a40459292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:31.183102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf737-0fb6-4f12-b12e-02a40459292e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:31.183589 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf737-0fb6-4f12-b12e-02a40459292e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:31.184090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf737-0fb6-4f12-b12e-02a40459292e None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:31.185150 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bf737-0fb6-4f12-b12e-02a40459292e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:31.185658 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bf737-0fb6-4f12-b12e-02a40459292e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:31.187379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bf737-0fb6-4f12-b12e-02a40459292e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:31.191526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950b309-d35f-4cc3-947f-00393cc582c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:31.192187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950b309-d35f-4cc3-947f-00393cc582c1 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:31.192463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950b309-d35f-4cc3-947f-00393cc582c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:31.192730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950b309-d35f-4cc3-947f-00393cc582c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:31.193463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950b309-d35f-4cc3-947f-00393cc582c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:31.193760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950b309-d35f-4cc3-947f-00393cc582c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:31.195131 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950b309-d35f-4cc3-947f-00393cc582c1 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:31.201066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 340/673] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:31.202170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bf737-0fb6-4f12-b12e-02a40459292e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:31.205524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 334/674] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:31.207811 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950b309-d35f-4cc3-947f-00393cc582c1 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:31.303639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bf737-0fb6-4f12-b12e-02a40459292e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:31.329201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950b309-d35f-4cc3-947f-00393cc582c1 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:31.341030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403c3e9-8b60-4053-8a72-7b74cf522c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:31.341822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c3e9-8b60-4053-8a72-7b74cf522c31 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:31.342104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c3e9-8b60-4053-8a72-7b74cf522c31 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:31.342378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c3e9-8b60-4053-8a72-7b74cf522c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:31.353896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403c3e9-8b60-4053-8a72-7b74cf522c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:31.355373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403c3e9-8b60-4053-8a72-7b74cf522c31 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:31.369079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabc217-7923-43d5-bca9-5785820a90cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:31.370022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabc217-7923-43d5-bca9-5785820a90cc None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:31.370493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabc217-7923-43d5-bca9-5785820a90cc None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:31.370986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabc217-7923-43d5-bca9-5785820a90cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:31.372006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabc217-7923-43d5-bca9-5785820a90cc None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=80ad61a348b2450baceb030f98150647) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:31.372515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabc217-7923-43d5-bca9-5785820a90cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:31.374204 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabc217-7923-43d5-bca9-5785820a90cc None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:31.374309 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-7403c3e9-8b60-4053-8a72-7b74cf522c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:31.379925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 341/675] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:31.379925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403c3e9-8b60-4053-8a72-7b74cf522c31 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:31.386750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 335/676] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:31 2022] GET /identity/v3/role_assignments?user.id=80ad61a348b2450baceb030f98150647&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:31.387874 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabc217-7923-43d5-bca9-5785820a90cc None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:31.535145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403c3e9-8b60-4053-8a72-7b74cf522c31 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:31.555038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabc217-7923-43d5-bca9-5785820a90cc None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:31.587529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576c1ba-cc14-4dcb-be96-bf831eaeb83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:31.588659 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576c1ba-cc14-4dcb-be96-bf831eaeb83c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:31.589169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576c1ba-cc14-4dcb-be96-bf831eaeb83c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:31.590395 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576c1ba-cc14-4dcb-be96-bf831eaeb83c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:31.594262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a8d7a-1050-4edb-83e1-9accb7d7fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:31.594979 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a8d7a-1050-4edb-83e1-9accb7d7fadf None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:31.595259 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a8d7a-1050-4edb-83e1-9accb7d7fadf None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:31.595527 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a8d7a-1050-4edb-83e1-9accb7d7fadf None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:31.596230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a8d7a-1050-4edb-83e1-9accb7d7fadf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:31.596525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a8d7a-1050-4edb-83e1-9accb7d7fadf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:31.598371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a8d7a-1050-4edb-83e1-9accb7d7fadf None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:31.606618 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576c1ba-cc14-4dcb-be96-bf831eaeb83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:31.607750 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576c1ba-cc14-4dcb-be96-bf831eaeb83c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:31.613011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 336/677] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:31.614342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ad2c2-01fa-45a2-9658-4967cb8e9bc1 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:31.614627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ad2c2-01fa-45a2-9658-4967cb8e9bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:31.614920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ad2c2-01fa-45a2-9658-4967cb8e9bc1 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:31.616708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 337/678] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:31.624679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b1c97-087c-477e-b9f3-f85252bf732a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:31.624679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b1c97-087c-477e-b9f3-f85252bf732a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:31.624679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b1c97-087c-477e-b9f3-f85252bf732a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:31.635227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-2576c1ba-cc14-4dcb-be96-bf831eaeb83c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:31.636688 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 342/679] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:31.637476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576c1ba-cc14-4dcb-be96-bf831eaeb83c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:31.639715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-005b1c97-087c-477e-b9f3-f85252bf732a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:31.642255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-005b1c97-087c-477e-b9f3-f85252bf732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:31.725356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 338/680] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:25:31.726646 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b1c97-087c-477e-b9f3-f85252bf732a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:31.769649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576c1ba-cc14-4dcb-be96-bf831eaeb83c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:31.813000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471dbe-c139-4c5d-89a7-b4e449efced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:31.814472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471dbe-c139-4c5d-89a7-b4e449efced7 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:31.814760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471dbe-c139-4c5d-89a7-b4e449efced7 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:31.815067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471dbe-c139-4c5d-89a7-b4e449efced7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:31.823415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471dbe-c139-4c5d-89a7-b4e449efced7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:31.825441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471dbe-c139-4c5d-89a7-b4e449efced7 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:31.843918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-03471dbe-c139-4c5d-89a7-b4e449efced7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:31.845491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 343/681] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:31.846038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b1c97-087c-477e-b9f3-f85252bf732a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:31.850782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471dbe-c139-4c5d-89a7-b4e449efced7 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:31.890579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6fbc1-7f88-4078-868a-6dd9ca9ca815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:31.891727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6fbc1-7f88-4078-868a-6dd9ca9ca815 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:31.892017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6fbc1-7f88-4078-868a-6dd9ca9ca815 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:31.892290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6fbc1-7f88-4078-868a-6dd9ca9ca815 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:31.893014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6fbc1-7f88-4078-868a-6dd9ca9ca815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:31.893314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6fbc1-7f88-4078-868a-6dd9ca9ca815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:31.895373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6fbc1-7f88-4078-868a-6dd9ca9ca815 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:31.908050 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 339/682] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:31.909025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6fbc1-7f88-4078-868a-6dd9ca9ca815 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:31.968150 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471dbe-c139-4c5d-89a7-b4e449efced7 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:32.007056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6fbc1-7f88-4078-868a-6dd9ca9ca815 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:32.011956 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0fd2d-9d59-448c-bebc-b431cbf21fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:32.012850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0fd2d-9d59-448c-bebc-b431cbf21fa5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.013236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0fd2d-9d59-448c-bebc-b431cbf21fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.013633 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0fd2d-9d59-448c-bebc-b431cbf21fa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.026794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0fd2d-9d59-448c-bebc-b431cbf21fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:32.036600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-f8a0fd2d-9d59-448c-bebc-b431cbf21fa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:25:32.040800 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533e22-159a-4b93-a9f6-602f4fc7e7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:32.041507 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533e22-159a-4b93-a9f6-602f4fc7e7e7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.041786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533e22-159a-4b93-a9f6-602f4fc7e7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.042107 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533e22-159a-4b93-a9f6-602f4fc7e7e7 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.043054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 344/683] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:32.043233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12533e22-159a-4b93-a9f6-602f4fc7e7e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:32.043474 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12533e22-159a-4b93-a9f6-602f4fc7e7e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:32.043901 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0fd2d-9d59-448c-bebc-b431cbf21fa5 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:32.045150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12533e22-159a-4b93-a9f6-602f4fc7e7e7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:32.063257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 340/684] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:32.064142 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533e22-159a-4b93-a9f6-602f4fc7e7e7 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:32.154333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0fd2d-9d59-448c-bebc-b431cbf21fa5 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:32.186534 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533e22-159a-4b93-a9f6-602f4fc7e7e7 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:32.191173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b70d7-7410-4112-8976-7193c9ca049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:32.192169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b70d7-7410-4112-8976-7193c9ca049c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.192647 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b70d7-7410-4112-8976-7193c9ca049c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.193097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b70d7-7410-4112-8976-7193c9ca049c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.201075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b70d7-7410-4112-8976-7193c9ca049c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:32.202842 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b70d7-7410-4112-8976-7193c9ca049c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:32.216404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-7d2b70d7-7410-4112-8976-7193c9ca049c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:25:32.218095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 345/685] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:32.219206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b70d7-7410-4112-8976-7193c9ca049c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:32.226709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5e239-4be6-4b1e-8491-dea5ccf91e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:32.227427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e239-4be6-4b1e-8491-dea5ccf91e41 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.227707 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e239-4be6-4b1e-8491-dea5ccf91e41 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.227974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e239-4be6-4b1e-8491-dea5ccf91e41 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.228711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5e239-4be6-4b1e-8491-dea5ccf91e41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:32.229009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5e239-4be6-4b1e-8491-dea5ccf91e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:32.230359 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5e239-4be6-4b1e-8491-dea5ccf91e41 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:32.239715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 341/686] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:32.240646 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5e239-4be6-4b1e-8491-dea5ccf91e41 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:32.334430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b70d7-7410-4112-8976-7193c9ca049c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:32.363758 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5e239-4be6-4b1e-8491-dea5ccf91e41 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:32.372864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec69b2b-09f3-4103-9d47-43bbf8a8ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:32.373512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69b2b-09f3-4103-9d47-43bbf8a8ec04 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.373794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69b2b-09f3-4103-9d47-43bbf8a8ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.374064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69b2b-09f3-4103-9d47-43bbf8a8ec04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.375442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec69b2b-09f3-4103-9d47-43bbf8a8ec04 None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=44fb3491570c41cbb7271cfce1c31e39) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:32.375747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec69b2b-09f3-4103-9d47-43bbf8a8ec04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:32.377154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec69b2b-09f3-4103-9d47-43bbf8a8ec04 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:32.383322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 346/687] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:32 2022] GET /identity/v3/role_assignments?user.id=44fb3491570c41cbb7271cfce1c31e39&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:32.384194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec69b2b-09f3-4103-9d47-43bbf8a8ec04 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:32.399431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d627e9d-b3a2-4187-8eec-b69c9c0c806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:32.400112 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d627e9d-b3a2-4187-8eec-b69c9c0c806a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.400429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d627e9d-b3a2-4187-8eec-b69c9c0c806a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.400704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d627e9d-b3a2-4187-8eec-b69c9c0c806a None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.401542 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d627e9d-b3a2-4187-8eec-b69c9c0c806a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:32.401846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d627e9d-b3a2-4187-8eec-b69c9c0c806a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:32.403381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d627e9d-b3a2-4187-8eec-b69c9c0c806a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:32.422697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 342/688] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Feb 28 10:25:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:32.428344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d627e9d-b3a2-4187-8eec-b69c9c0c806a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:32.488516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec69b2b-09f3-4103-9d47-43bbf8a8ec04 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:32.524569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c21ae-62b3-466f-b7f2-bb52234dc576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:32.525409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c21ae-62b3-466f-b7f2-bb52234dc576 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.525948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c21ae-62b3-466f-b7f2-bb52234dc576 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.526577 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c21ae-62b3-466f-b7f2-bb52234dc576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.532668 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d627e9d-b3a2-4187-8eec-b69c9c0c806a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:32.541081 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c21ae-62b3-466f-b7f2-bb52234dc576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:32.542959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c21ae-62b3-466f-b7f2-bb52234dc576 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:32.566015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-3d9c21ae-62b3-466f-b7f2-bb52234dc576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:32.567538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da946b09-d7cb-4dc2-93b5-67ae5a66d25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:32.567660 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 347/689] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:32.568297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da946b09-d7cb-4dc2-93b5-67ae5a66d25b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.568576 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da946b09-d7cb-4dc2-93b5-67ae5a66d25b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.568872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da946b09-d7cb-4dc2-93b5-67ae5a66d25b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.579987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c21ae-62b3-466f-b7f2-bb52234dc576 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:32.646378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da946b09-d7cb-4dc2-93b5-67ae5a66d25b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:32.647969 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da946b09-d7cb-4dc2-93b5-67ae5a66d25b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:32.721416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c21ae-62b3-466f-b7f2-bb52234dc576 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:32.761210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf3871-7ce8-4a08-b2e1-0d7d01133620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:32.762144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3871-7ce8-4a08-b2e1-0d7d01133620 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.762570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3871-7ce8-4a08-b2e1-0d7d01133620 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.763017 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3871-7ce8-4a08-b2e1-0d7d01133620 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.763871 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf3871-7ce8-4a08-b2e1-0d7d01133620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:32.764319 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf3871-7ce8-4a08-b2e1-0d7d01133620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:32.766483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf3871-7ce8-4a08-b2e1-0d7d01133620 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:32.770261 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 343/690] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:25:32.771867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67134d7-6974-4735-a49b-868307503795 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.772229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67134d7-6974-4735-a49b-868307503795 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.772577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67134d7-6974-4735-a49b-868307503795 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.775077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 344/691] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:32.775907 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67134d7-6974-4735-a49b-868307503795 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:32.789633 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 348/692] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:32.795434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6f548-c6d5-4f75-9efe-63ae9074c8b7 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.796738 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6f548-c6d5-4f75-9efe-63ae9074c8b7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.797016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6f548-c6d5-4f75-9efe-63ae9074c8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.816920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-50d6f548-c6d5-4f75-9efe-63ae9074c8b7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:32.818378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-50d6f548-c6d5-4f75-9efe-63ae9074c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:32.885213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 349/693] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:32.886282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6f548-c6d5-4f75-9efe-63ae9074c8b7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:32.925901 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67134d7-6974-4735-a49b-868307503795 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:32.968922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dd30d-770c-4e6a-8343-81e2e982181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:32.970063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd30d-770c-4e6a-8343-81e2e982181a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:32.970543 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd30d-770c-4e6a-8343-81e2e982181a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:32.971063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd30d-770c-4e6a-8343-81e2e982181a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:32.984453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dd30d-770c-4e6a-8343-81e2e982181a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:32.986538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dd30d-770c-4e6a-8343-81e2e982181a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:32.997721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6f548-c6d5-4f75-9efe-63ae9074c8b7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:33.007905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-b87dd30d-770c-4e6a-8343-81e2e982181a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:33.009510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 345/694] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:33.010994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dd30d-770c-4e6a-8343-81e2e982181a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:33.033905 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520cd62-e1be-4cdd-b073-024726968431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:33.034959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520cd62-e1be-4cdd-b073-024726968431 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.035413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520cd62-e1be-4cdd-b073-024726968431 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.035829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520cd62-e1be-4cdd-b073-024726968431 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.043190 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520cd62-e1be-4cdd-b073-024726968431 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:33.044792 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520cd62-e1be-4cdd-b073-024726968431 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:33.059993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-b520cd62-e1be-4cdd-b073-024726968431 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:25:33.061627 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 350/695] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Feb 28 10:25:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:33.062674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520cd62-e1be-4cdd-b073-024726968431 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:33.133029 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dd30d-770c-4e6a-8343-81e2e982181a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:33.172689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520cd62-e1be-4cdd-b073-024726968431 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:33.177664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9491cd-fa4d-4459-9518-5b876528d50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:33.178417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9491cd-fa4d-4459-9518-5b876528d50b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.178765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9491cd-fa4d-4459-9518-5b876528d50b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.178986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9491cd-fa4d-4459-9518-5b876528d50b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.179642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9491cd-fa4d-4459-9518-5b876528d50b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:33.180999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9491cd-fa4d-4459-9518-5b876528d50b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:33.197561 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-7d9491cd-fa4d-4459-9518-5b876528d50b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 10:25:33.202977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 346/696] 10.222.0.44 () {56 vars in 1129 bytes} [Mon Feb 28 10:25:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:33.204341 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9491cd-fa4d-4459-9518-5b876528d50b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:33.214049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5357b0-5534-47f5-bb6e-9f82e049b179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:33.214709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5357b0-5534-47f5-bb6e-9f82e049b179 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.215029 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5357b0-5534-47f5-bb6e-9f82e049b179 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.215305 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5357b0-5534-47f5-bb6e-9f82e049b179 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.216084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5357b0-5534-47f5-bb6e-9f82e049b179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:33.216388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5357b0-5534-47f5-bb6e-9f82e049b179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:33.217975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5357b0-5534-47f5-bb6e-9f82e049b179 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:33.231989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 351/697] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:33.232876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5357b0-5534-47f5-bb6e-9f82e049b179 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:33.332873 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9491cd-fa4d-4459-9518-5b876528d50b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:33.335094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5357b0-5534-47f5-bb6e-9f82e049b179 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:33.372209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7870e-a25c-4fda-9746-272f9efc5772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:33.372874 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7870e-a25c-4fda-9746-272f9efc5772 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.373156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7870e-a25c-4fda-9746-272f9efc5772 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.373431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7870e-a25c-4fda-9746-272f9efc5772 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.374135 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7870e-a25c-4fda-9746-272f9efc5772 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:33.375007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7870e-a25c-4fda-9746-272f9efc5772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:33.376372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7870e-a25c-4fda-9746-272f9efc5772 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:33.377227 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da934b6a-de6d-4647-ade6-e181808e94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:33.378384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934b6a-de6d-4647-ade6-e181808e94ac None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.378670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934b6a-de6d-4647-ade6-e181808e94ac None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.379100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934b6a-de6d-4647-ade6-e181808e94ac None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.380104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da934b6a-de6d-4647-ade6-e181808e94ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:33.380421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da934b6a-de6d-4647-ade6-e181808e94ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:33.381023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 352/698] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Feb 28 10:25:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:33.381810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7870e-a25c-4fda-9746-272f9efc5772 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:33.384139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da934b6a-de6d-4647-ade6-e181808e94ac None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:33.402571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 347/699] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Feb 28 10:25:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:33.403451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da934b6a-de6d-4647-ade6-e181808e94ac None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:33.503035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da934b6a-de6d-4647-ade6-e181808e94ac None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:33.515921 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7870e-a25c-4fda-9746-272f9efc5772 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:33.536920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4f03c-df2c-42e0-829f-501daa0a2e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:33.537581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4f03c-df2c-42e0-829f-501daa0a2e58 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.537862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4f03c-df2c-42e0-829f-501daa0a2e58 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.538136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4f03c-df2c-42e0-829f-501daa0a2e58 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.538834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4f03c-df2c-42e0-829f-501daa0a2e58 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:33.539186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4f03c-df2c-42e0-829f-501daa0a2e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:33.540571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4f03c-df2c-42e0-829f-501daa0a2e58 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:33.547108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 348/700] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Feb 28 10:25:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:33.547934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4f03c-df2c-42e0-829f-501daa0a2e58 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:33.571667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39e57-0866-4a84-8458-b8932122b421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:33.572480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39e57-0866-4a84-8458-b8932122b421 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.572806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39e57-0866-4a84-8458-b8932122b421 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.573078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39e57-0866-4a84-8458-b8932122b421 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.586867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39e57-0866-4a84-8458-b8932122b421 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:33.588590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39e57-0866-4a84-8458-b8932122b421 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:33.617959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-74f39e57-0866-4a84-8458-b8932122b421 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:33.619297 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 353/701] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:33.629736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39e57-0866-4a84-8458-b8932122b421 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:33.747563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4f03c-df2c-42e0-829f-501daa0a2e58 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:33.806243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0db80-99a7-4a1b-90ed-351b65bc1e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:33.807191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0db80-99a7-4a1b-90ed-351b65bc1e78 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.807754 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0db80-99a7-4a1b-90ed-351b65bc1e78 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.808030 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0db80-99a7-4a1b-90ed-351b65bc1e78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.813728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39e57-0866-4a84-8458-b8932122b421 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:33.853857 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cabccb-afd9-4e28-be39-c90f25458067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:33.854513 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabccb-afd9-4e28-be39-c90f25458067 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.854797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabccb-afd9-4e28-be39-c90f25458067 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.855099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabccb-afd9-4e28-be39-c90f25458067 None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.855884 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cabccb-afd9-4e28-be39-c90f25458067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:33.856193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cabccb-afd9-4e28-be39-c90f25458067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:33.858056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cabccb-afd9-4e28-be39-c90f25458067 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:33.873649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 354/702] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:33.879332 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cabccb-afd9-4e28-be39-c90f25458067 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:33.892043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0db80-99a7-4a1b-90ed-351b65bc1e78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:33.893903 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0db80-99a7-4a1b-90ed-351b65bc1e78 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:34.048744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cabccb-afd9-4e28-be39-c90f25458067 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:34.068395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 349/703] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:34.070490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264e57d-2c6d-4d1b-897b-1c35fbb8b73d None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:34.071022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264e57d-2c6d-4d1b-897b-1c35fbb8b73d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:34.071490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264e57d-2c6d-4d1b-897b-1c35fbb8b73d None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:34.077683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 350/704] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:34.077683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264e57d-2c6d-4d1b-897b-1c35fbb8b73d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:34.097213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d43c7a-d4e1-4114-8e62-6006a32ffa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:34.097791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d43c7a-d4e1-4114-8e62-6006a32ffa4c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:34.098074 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d43c7a-d4e1-4114-8e62-6006a32ffa4c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:34.098347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d43c7a-d4e1-4114-8e62-6006a32ffa4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:34.099200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d43c7a-d4e1-4114-8e62-6006a32ffa4c None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=4f6db1c2542943928de6132ec9e61c84) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:34.099512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d43c7a-d4e1-4114-8e62-6006a32ffa4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:34.100945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d43c7a-d4e1-4114-8e62-6006a32ffa4c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:34.107242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 355/705] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:33 2022] GET /identity/v3/role_assignments?user.id=4f6db1c2542943928de6132ec9e61c84&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:34.108548 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb665-90d3-4954-bf19-1721116a9ac3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:34.109425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb665-90d3-4954-bf19-1721116a9ac3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:34.109729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb665-90d3-4954-bf19-1721116a9ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:34.127703 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-7e7fb665-90d3-4954-bf19-1721116a9ac3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:34.129007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7e7fb665-90d3-4954-bf19-1721116a9ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:34.205866 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 356/706] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:34.223316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264e57d-2c6d-4d1b-897b-1c35fbb8b73d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:34.242476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fb665-90d3-4954-bf19-1721116a9ac3 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:34.302062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097adc9-7f8c-4dcf-9759-8859955e2006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:34.302930 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097adc9-7f8c-4dcf-9759-8859955e2006 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:34.303217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097adc9-7f8c-4dcf-9759-8859955e2006 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:34.303484 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097adc9-7f8c-4dcf-9759-8859955e2006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:34.330744 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097adc9-7f8c-4dcf-9759-8859955e2006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:34.332315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097adc9-7f8c-4dcf-9759-8859955e2006 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:34.356430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e097adc9-7f8c-4dcf-9759-8859955e2006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:34.357996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 351/707] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:34.364603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097adc9-7f8c-4dcf-9759-8859955e2006 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:34.404769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fb665-90d3-4954-bf19-1721116a9ac3 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:34.446363 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5476-18a1-4855-b5d4-70af51552f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:34.447531 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5476-18a1-4855-b5d4-70af51552f6a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:34.448101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5476-18a1-4855-b5d4-70af51552f6a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:34.448380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5476-18a1-4855-b5d4-70af51552f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:34.461843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5476-18a1-4855-b5d4-70af51552f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:34.463361 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5476-18a1-4855-b5d4-70af51552f6a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:34.486281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-ee1a5476-18a1-4855-b5d4-70af51552f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:34.490993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 357/708] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:34.494656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097adc9-7f8c-4dcf-9759-8859955e2006 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:34.495793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5476-18a1-4855-b5d4-70af51552f6a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:34.532710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205bcb6-f40f-42ab-b494-261d44b88f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:34.533238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205bcb6-f40f-42ab-b494-261d44b88f0b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:34.533515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205bcb6-f40f-42ab-b494-261d44b88f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:34.533787 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205bcb6-f40f-42ab-b494-261d44b88f0b None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:34.534500 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205bcb6-f40f-42ab-b494-261d44b88f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:34.534797 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205bcb6-f40f-42ab-b494-261d44b88f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:34.536257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205bcb6-f40f-42ab-b494-261d44b88f0b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:34.548328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 352/709] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:34.553571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205bcb6-f40f-42ab-b494-261d44b88f0b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:34.619973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5476-18a1-4855-b5d4-70af51552f6a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:34.662185 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c101c-6282-42ca-a9b2-6c74a0c761dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:34.663199 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c101c-6282-42ca-a9b2-6c74a0c761dc None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:34.663619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c101c-6282-42ca-a9b2-6c74a0c761dc None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:34.664054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c101c-6282-42ca-a9b2-6c74a0c761dc None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:34.664988 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c101c-6282-42ca-a9b2-6c74a0c761dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:34.665495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c101c-6282-42ca-a9b2-6c74a0c761dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:34.667116 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c101c-6282-42ca-a9b2-6c74a0c761dc None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:34.676838 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205bcb6-f40f-42ab-b494-261d44b88f0b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:34.683873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 358/710] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:34.687351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c101c-6282-42ca-a9b2-6c74a0c761dc None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:34.724044 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17977ef4-3b65-44a9-97da-75e08112be13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:34.724823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977ef4-3b65-44a9-97da-75e08112be13 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:34.725102 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977ef4-3b65-44a9-97da-75e08112be13 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:34.725370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977ef4-3b65-44a9-97da-75e08112be13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:34.734865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17977ef4-3b65-44a9-97da-75e08112be13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:34.736984 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17977ef4-3b65-44a9-97da-75e08112be13 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:34.756519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-17977ef4-3b65-44a9-97da-75e08112be13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:34.758997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 353/711] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:34.764302 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17977ef4-3b65-44a9-97da-75e08112be13 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:34.800655 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c101c-6282-42ca-a9b2-6c74a0c761dc None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:34.842093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ddab-c74f-4575-8c7c-6db7cecbe2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:34.843693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ddab-c74f-4575-8c7c-6db7cecbe2d9 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:34.844168 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ddab-c74f-4575-8c7c-6db7cecbe2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:34.844654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ddab-c74f-4575-8c7c-6db7cecbe2d9 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:34.845552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98ddab-c74f-4575-8c7c-6db7cecbe2d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:34.847203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98ddab-c74f-4575-8c7c-6db7cecbe2d9 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:34.868625 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17977ef4-3b65-44a9-97da-75e08112be13 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:34.885910 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 359/712] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:25:34 2022] POST /identity/v3/users => generated 254 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:25:34.905385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33a536-9a30-46de-a509-0af052dd0954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:34.906138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a536-9a30-46de-a509-0af052dd0954 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:34.906472 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a536-9a30-46de-a509-0af052dd0954 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:34.906740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a536-9a30-46de-a509-0af052dd0954 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:34.907628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33a536-9a30-46de-a509-0af052dd0954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:34.907937 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33a536-9a30-46de-a509-0af052dd0954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:34.909440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33a536-9a30-46de-a509-0af052dd0954 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:34.923431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 354/713] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:34.929048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ddab-c74f-4575-8c7c-6db7cecbe2d9 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:35.057217 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ddab-c74f-4575-8c7c-6db7cecbe2d9 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:35.067300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa6043-21d1-4c7e-b966-61f5310d66e9 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:35.067604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa6043-21d1-4c7e-b966-61f5310d66e9 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:35.067858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa6043-21d1-4c7e-b966-61f5310d66e9 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:35.069897 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 355/714] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:35.078928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5aaf8-db83-420d-8691-0ffe75b17253 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:35.078928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5aaf8-db83-420d-8691-0ffe75b17253 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:35.078928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5aaf8-db83-420d-8691-0ffe75b17253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:35.104167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b017af3-5010-4352-845f-3de1f038ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:35.104834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b017af3-5010-4352-845f-3de1f038ac69 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:35.105118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b017af3-5010-4352-845f-3de1f038ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:35.105393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b017af3-5010-4352-845f-3de1f038ac69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:35.106227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b017af3-5010-4352-845f-3de1f038ac69 None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=b4132c15e66a4a619574f7aba10d6d71) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:35.106540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b017af3-5010-4352-845f-3de1f038ac69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:35.108000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b017af3-5010-4352-845f-3de1f038ac69 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:35.114600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 360/715] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:34 2022] GET /identity/v3/role_assignments?user.id=b4132c15e66a4a619574f7aba10d6d71&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:35.129514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-98f5aaf8-db83-420d-8691-0ffe75b17253 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:35.130761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-98f5aaf8-db83-420d-8691-0ffe75b17253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:35.215207 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 356/716] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:35.238745 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b017af3-5010-4352-845f-3de1f038ac69 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:35.364644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b017af3-5010-4352-845f-3de1f038ac69 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:35.410334 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e3520-18e5-4267-a3b9-ef64d50cce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:35.411157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e3520-18e5-4267-a3b9-ef64d50cce33 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:35.411439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e3520-18e5-4267-a3b9-ef64d50cce33 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:35.411763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e3520-18e5-4267-a3b9-ef64d50cce33 None admin] PATH_INFO: `/v3/services/network` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:35.412423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e3520-18e5-4267-a3b9-ef64d50cce33 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:35.413783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e3520-18e5-4267-a3b9-ef64d50cce33 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:35.430735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-d56e3520-18e5-4267-a3b9-ef64d50cce33 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 10:25:35.431972 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 361/717] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:35 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:35.438286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5aaf8-db83-420d-8691-0ffe75b17253 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:35.555016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5aaf8-db83-420d-8691-0ffe75b17253 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:35.594418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6d0c2-ba16-41b6-9a73-1f5090110ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:35.595117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d0c2-ba16-41b6-9a73-1f5090110ac0 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:35.595397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d0c2-ba16-41b6-9a73-1f5090110ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:35.595668 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d0c2-ba16-41b6-9a73-1f5090110ac0 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:35.596375 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6d0c2-ba16-41b6-9a73-1f5090110ac0 None admin] RBAC: Adding query filter params (name=network) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:35.596676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6d0c2-ba16-41b6-9a73-1f5090110ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:35.598041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6d0c2-ba16-41b6-9a73-1f5090110ac0 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:35.602603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 357/718] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:25:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:35.608082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e3520-18e5-4267-a3b9-ef64d50cce33 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:35.714376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e3520-18e5-4267-a3b9-ef64d50cce33 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:35.754274 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12003b8-3d94-4c46-864e-245cf58c4e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:35.754958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12003b8-3d94-4c46-864e-245cf58c4e75 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:35.755241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12003b8-3d94-4c46-864e-245cf58c4e75 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:35.755515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12003b8-3d94-4c46-864e-245cf58c4e75 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:35.756222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12003b8-3d94-4c46-864e-245cf58c4e75 None admin] RBAC: Adding query filter params (type=network) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:35.756528 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12003b8-3d94-4c46-864e-245cf58c4e75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:35.757882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12003b8-3d94-4c46-864e-245cf58c4e75 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:35.764091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 362/719] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:25:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:36.433127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7786588-6441-404c-8fee-f73bf57c5321 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:36.434946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7786588-6441-404c-8fee-f73bf57c5321 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:36.434946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7786588-6441-404c-8fee-f73bf57c5321 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:36.436462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 358/720] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:36.442681 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f469d-530b-48f2-b88f-ababe152bd80 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:36.443316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f469d-530b-48f2-b88f-ababe152bd80 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:36.443316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f469d-530b-48f2-b88f-ababe152bd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:36.464763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-047f469d-530b-48f2-b88f-ababe152bd80 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:36.465951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-047f469d-530b-48f2-b88f-ababe152bd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:36.555290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 363/721] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:36.595067 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7786588-6441-404c-8fee-f73bf57c5321 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:36.733117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7786588-6441-404c-8fee-f73bf57c5321 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:36.779389 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc19d1-6d49-4cee-9b8c-bf4c8984d979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:36.780117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc19d1-6d49-4cee-9b8c-bf4c8984d979 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:36.780400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc19d1-6d49-4cee-9b8c-bf4c8984d979 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:36.781192 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc19d1-6d49-4cee-9b8c-bf4c8984d979 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:36.781919 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc19d1-6d49-4cee-9b8c-bf4c8984d979 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:36.783311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc19d1-6d49-4cee-9b8c-bf4c8984d979 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:36.804258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 359/722] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:25:36 2022] POST /identity/v3/services => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:25:37.353677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82805-aeb3-4b8f-aa50-fd8f563d9381 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:37.354048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82805-aeb3-4b8f-aa50-fd8f563d9381 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:37.354225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82805-aeb3-4b8f-aa50-fd8f563d9381 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:37.356272 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 364/723] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:37.361595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec851-3391-4f14-87b9-0ff8433ccfd0 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:37.361885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec851-3391-4f14-87b9-0ff8433ccfd0 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:37.362158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec851-3391-4f14-87b9-0ff8433ccfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:37.380093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-635ec851-3391-4f14-87b9-0ff8433ccfd0 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:37.381267 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-635ec851-3391-4f14-87b9-0ff8433ccfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:37.458858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 360/724] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:37.484769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82805-aeb3-4b8f-aa50-fd8f563d9381 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:37.652285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82805-aeb3-4b8f-aa50-fd8f563d9381 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:37.697713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dee69-a6a9-49b5-bfe5-7943ac5fd82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:37.698506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dee69-a6a9-49b5-bfe5-7943ac5fd82e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:37.698783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dee69-a6a9-49b5-bfe5-7943ac5fd82e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:37.699076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dee69-a6a9-49b5-bfe5-7943ac5fd82e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:37.713416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dee69-a6a9-49b5-bfe5-7943ac5fd82e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:37.720857 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-6e7dee69-a6a9-49b5-bfe5-7943ac5fd82e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:25:37.722382 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 365/725] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:37.731986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ec851-3391-4f14-87b9-0ff8433ccfd0 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:37.850606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ec851-3391-4f14-87b9-0ff8433ccfd0 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:37.884732 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0462c-e7cd-46a8-be91-9b4dced5006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:37.885655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0462c-e7cd-46a8-be91-9b4dced5006a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:37.885930 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0462c-e7cd-46a8-be91-9b4dced5006a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:37.886198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0462c-e7cd-46a8-be91-9b4dced5006a None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:37.886941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0462c-e7cd-46a8-be91-9b4dced5006a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:37.887243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0462c-e7cd-46a8-be91-9b4dced5006a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:37.888600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0462c-e7cd-46a8-be91-9b4dced5006a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:37.892295 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85b6c-df2b-42d8-9b33-6af9dc3eafba None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:37.892823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85b6c-df2b-42d8-9b33-6af9dc3eafba None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:37.893305 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85b6c-df2b-42d8-9b33-6af9dc3eafba None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:37.897891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 361/726] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:37.898536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 366/727] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:37.903451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0462c-e7cd-46a8-be91-9b4dced5006a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:37.904384 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4c17b-f625-4eba-bca9-2a9808d480fe None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:37.904745 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4c17b-f625-4eba-bca9-2a9808d480fe None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:37.905125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4c17b-f625-4eba-bca9-2a9808d480fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:37.940037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2aa4c17b-f625-4eba-bca9-2a9808d480fe None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:37.941242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2aa4c17b-f625-4eba-bca9-2a9808d480fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:38.017526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0462c-e7cd-46a8-be91-9b4dced5006a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:38.045236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 367/728] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:38.073968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4c17b-f625-4eba-bca9-2a9808d480fe None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:38.074225 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcade4-44bd-4cf2-bda6-10b9c4505fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:38.075237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcade4-44bd-4cf2-bda6-10b9c4505fbf None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.075670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcade4-44bd-4cf2-bda6-10b9c4505fbf None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.076079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcade4-44bd-4cf2-bda6-10b9c4505fbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.088607 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcade4-44bd-4cf2-bda6-10b9c4505fbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:38.090279 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcade4-44bd-4cf2-bda6-10b9c4505fbf None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:38.109943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-45fcade4-44bd-4cf2-bda6-10b9c4505fbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:38.112046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 362/729] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:38.116858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcade4-44bd-4cf2-bda6-10b9c4505fbf None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:38.200831 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4c17b-f625-4eba-bca9-2a9808d480fe None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:38.219977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcade4-44bd-4cf2-bda6-10b9c4505fbf None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:38.238151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27b8be-f739-4a41-a7dd-7bcc486c17c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:38.239207 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27b8be-f739-4a41-a7dd-7bcc486c17c9 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.239350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27b8be-f739-4a41-a7dd-7bcc486c17c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.239528 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27b8be-f739-4a41-a7dd-7bcc486c17c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.250547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27b8be-f739-4a41-a7dd-7bcc486c17c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:38.257213 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6491cb3-0c0a-4a82-8f44-4a0d424d9863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:38.257430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-cc27b8be-f739-4a41-a7dd-7bcc486c17c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:25:38.258218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491cb3-0c0a-4a82-8f44-4a0d424d9863 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.258637 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491cb3-0c0a-4a82-8f44-4a0d424d9863 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.258982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 368/730] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:38.259287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491cb3-0c0a-4a82-8f44-4a0d424d9863 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.260454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6491cb3-0c0a-4a82-8f44-4a0d424d9863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:38.260582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e05c39-7ec3-4e85-97c0-49eaea35b310 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.260771 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e05c39-7ec3-4e85-97c0-49eaea35b310 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.261047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e05c39-7ec3-4e85-97c0-49eaea35b310 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.261322 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6491cb3-0c0a-4a82-8f44-4a0d424d9863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:38.262871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6491cb3-0c0a-4a82-8f44-4a0d424d9863 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:38.266933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 369/731] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:38.267756 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e05c39-7ec3-4e85-97c0-49eaea35b310 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:38.277141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 363/732] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:38.278800 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bde70-4877-4720-bad3-2563c2f02ab4 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.279305 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bde70-4877-4720-bad3-2563c2f02ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.279780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bde70-4877-4720-bad3-2563c2f02ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.297206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ca3bde70-4877-4720-bad3-2563c2f02ab4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:38.298654 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ca3bde70-4877-4720-bad3-2563c2f02ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:38.371847 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e05c39-7ec3-4e85-97c0-49eaea35b310 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:38.378581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 364/733] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:38.379730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bde70-4877-4720-bad3-2563c2f02ab4 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:38.429880 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed933120-f644-49d2-a592-1d1b6e2fd9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:38.430556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed933120-f644-49d2-a592-1d1b6e2fd9f7 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.430841 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed933120-f644-49d2-a592-1d1b6e2fd9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.431167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed933120-f644-49d2-a592-1d1b6e2fd9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.431915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed933120-f644-49d2-a592-1d1b6e2fd9f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:38.432220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed933120-f644-49d2-a592-1d1b6e2fd9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:38.433795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed933120-f644-49d2-a592-1d1b6e2fd9f7 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:38.443176 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 370/734] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:38.444102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed933120-f644-49d2-a592-1d1b6e2fd9f7 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:38.481212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bde70-4877-4720-bad3-2563c2f02ab4 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:38.515767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeeca6-1fb7-47d1-a6d0-0664bf8bf3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:38.516846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeeca6-1fb7-47d1-a6d0-0664bf8bf3e3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.517297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeeca6-1fb7-47d1-a6d0-0664bf8bf3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.517734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeeca6-1fb7-47d1-a6d0-0664bf8bf3e3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.525527 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeeca6-1fb7-47d1-a6d0-0664bf8bf3e3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:38.527244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeeca6-1fb7-47d1-a6d0-0664bf8bf3e3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:38.543037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-49eeeca6-1fb7-47d1-a6d0-0664bf8bf3e3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:25:38.544813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed933120-f644-49d2-a592-1d1b6e2fd9f7 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:38.545362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 365/735] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:38.546483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeeca6-1fb7-47d1-a6d0-0664bf8bf3e3 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:38.579368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66a8c-845f-4d90-89a6-afe76f8e31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:38.580158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66a8c-845f-4d90-89a6-afe76f8e31d9 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.580548 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66a8c-845f-4d90-89a6-afe76f8e31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.580718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66a8c-845f-4d90-89a6-afe76f8e31d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.590810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a66a8c-845f-4d90-89a6-afe76f8e31d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:38.598194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-c2a66a8c-845f-4d90-89a6-afe76f8e31d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:38.599423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 371/736] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:38.600196 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66a8c-845f-4d90-89a6-afe76f8e31d9 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:38.658393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeeca6-1fb7-47d1-a6d0-0664bf8bf3e3 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:38.691036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022a00b-8ec0-441c-a08b-5e0a3951cc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:38.691825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022a00b-8ec0-441c-a08b-5e0a3951cc60 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.692102 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022a00b-8ec0-441c-a08b-5e0a3951cc60 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.692379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022a00b-8ec0-441c-a08b-5e0a3951cc60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.701546 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66a8c-845f-4d90-89a6-afe76f8e31d9 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:38.702146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022a00b-8ec0-441c-a08b-5e0a3951cc60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:38.704219 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022a00b-8ec0-441c-a08b-5e0a3951cc60 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:38.720757 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-d022a00b-8ec0-441c-a08b-5e0a3951cc60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:38.721945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 366/737] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:38.723174 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324e768-4d85-4e6f-8208-ad0730727fea None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.723454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324e768-4d85-4e6f-8208-ad0730727fea None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.723724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324e768-4d85-4e6f-8208-ad0730727fea None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.729226 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 367/738] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:38.729226 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324e768-4d85-4e6f-8208-ad0730727fea None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:38.741333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829815e6-ab80-468f-afa1-dd261d5dcf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:38.741940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829815e6-ab80-468f-afa1-dd261d5dcf58 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.742220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829815e6-ab80-468f-afa1-dd261d5dcf58 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.742500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829815e6-ab80-468f-afa1-dd261d5dcf58 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.743347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829815e6-ab80-468f-afa1-dd261d5dcf58 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:38.743663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829815e6-ab80-468f-afa1-dd261d5dcf58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:38.745085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829815e6-ab80-468f-afa1-dd261d5dcf58 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:38.762390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 372/739] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:38.763208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829815e6-ab80-468f-afa1-dd261d5dcf58 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:38.827828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324e768-4d85-4e6f-8208-ad0730727fea None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:38.857140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829815e6-ab80-468f-afa1-dd261d5dcf58 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:38.860791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a99de0-5f1d-46ef-a9d6-44cf862f95db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:38.861438 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99de0-5f1d-46ef-a9d6-44cf862f95db None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.861709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99de0-5f1d-46ef-a9d6-44cf862f95db None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.861974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99de0-5f1d-46ef-a9d6-44cf862f95db None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.862694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a99de0-5f1d-46ef-a9d6-44cf862f95db None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:38.863021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a99de0-5f1d-46ef-a9d6-44cf862f95db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:38.864395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a99de0-5f1d-46ef-a9d6-44cf862f95db None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:38.872016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 368/740] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:38.873425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36c376-61da-4b7d-910a-6e8aab547727 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.873712 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36c376-61da-4b7d-910a-6e8aab547727 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.873983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36c376-61da-4b7d-910a-6e8aab547727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.890831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ec36c376-61da-4b7d-910a-6e8aab547727 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:38.892074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ec36c376-61da-4b7d-910a-6e8aab547727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:38.895124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b14be1-d43c-4b2a-9b34-59460ac26e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:38.895779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b14be1-d43c-4b2a-9b34-59460ac26e9e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.896062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b14be1-d43c-4b2a-9b34-59460ac26e9e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.896338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b14be1-d43c-4b2a-9b34-59460ac26e9e None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.897054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b14be1-d43c-4b2a-9b34-59460ac26e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:38.897359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b14be1-d43c-4b2a-9b34-59460ac26e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:38.898714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b14be1-d43c-4b2a-9b34-59460ac26e9e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:38.910113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 373/741] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:38.910918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b14be1-d43c-4b2a-9b34-59460ac26e9e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:38.966238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 369/742] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:25:38.967387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36c376-61da-4b7d-910a-6e8aab547727 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:39.021616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b14be1-d43c-4b2a-9b34-59460ac26e9e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:39.059570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f536b6-f5a0-4d64-aea9-3e4eccba86d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:39.060215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f536b6-f5a0-4d64-aea9-3e4eccba86d1 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.060491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f536b6-f5a0-4d64-aea9-3e4eccba86d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.060757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f536b6-f5a0-4d64-aea9-3e4eccba86d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.073339 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36c376-61da-4b7d-910a-6e8aab547727 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:39.108842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48953b42-6c41-49af-9028-b36ac43fa363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:39.109622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48953b42-6c41-49af-9028-b36ac43fa363 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.109886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48953b42-6c41-49af-9028-b36ac43fa363 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.110176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48953b42-6c41-49af-9028-b36ac43fa363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.120333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48953b42-6c41-49af-9028-b36ac43fa363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:39.121767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48953b42-6c41-49af-9028-b36ac43fa363 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:39.132036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f536b6-f5a0-4d64-aea9-3e4eccba86d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:39.133447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f536b6-f5a0-4d64-aea9-3e4eccba86d1 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:39.138667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-48953b42-6c41-49af-9028-b36ac43fa363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:39.144758 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 370/743] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:39.144758 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48953b42-6c41-49af-9028-b36ac43fa363 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:39.233976 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 374/744] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:39.235048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f536b6-f5a0-4d64-aea9-3e4eccba86d1 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:39.243379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48953b42-6c41-49af-9028-b36ac43fa363 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:39.280050 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98bbff-a782-4d77-ac5e-7e27df7b181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:39.281393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98bbff-a782-4d77-ac5e-7e27df7b181c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.282014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98bbff-a782-4d77-ac5e-7e27df7b181c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.282723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98bbff-a782-4d77-ac5e-7e27df7b181c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.292121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98bbff-a782-4d77-ac5e-7e27df7b181c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:39.294223 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98bbff-a782-4d77-ac5e-7e27df7b181c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:39.313212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-6f98bbff-a782-4d77-ac5e-7e27df7b181c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:25:39.314731 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 371/745] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Feb 28 10:25:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:39.315731 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98bbff-a782-4d77-ac5e-7e27df7b181c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:39.334779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f536b6-f5a0-4d64-aea9-3e4eccba86d1 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:39.367633 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13224770-6602-4edc-bb99-c7d0fb0dac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:39.368289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224770-6602-4edc-bb99-c7d0fb0dac11 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.368566 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224770-6602-4edc-bb99-c7d0fb0dac11 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.368832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224770-6602-4edc-bb99-c7d0fb0dac11 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.369553 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13224770-6602-4edc-bb99-c7d0fb0dac11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:39.370923 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13224770-6602-4edc-bb99-c7d0fb0dac11 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:39.388916 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 375/746] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:25:39 2022] POST /identity/v3/services => generated 240 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:25:39.390836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13224770-6602-4edc-bb99-c7d0fb0dac11 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:39.435548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98bbff-a782-4d77-ac5e-7e27df7b181c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:39.479659 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e5782-5166-4fdc-983c-368e838b8153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:39.480718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e5782-5166-4fdc-983c-368e838b8153 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.481176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e5782-5166-4fdc-983c-368e838b8153 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.481622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e5782-5166-4fdc-983c-368e838b8153 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.482524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e5782-5166-4fdc-983c-368e838b8153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:39.483046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e5782-5166-4fdc-983c-368e838b8153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:39.485261 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e5782-5166-4fdc-983c-368e838b8153 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:39.502591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 372/747] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:39.502591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e5782-5166-4fdc-983c-368e838b8153 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:39.519647 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13224770-6602-4edc-bb99-c7d0fb0dac11 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:39.555602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a410482-5a88-4ea3-85af-e8f74a749692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:39.557177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410482-5a88-4ea3-85af-e8f74a749692 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.557460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410482-5a88-4ea3-85af-e8f74a749692 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.557735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410482-5a88-4ea3-85af-e8f74a749692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.569713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a410482-5a88-4ea3-85af-e8f74a749692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:39.571208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a410482-5a88-4ea3-85af-e8f74a749692 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:39.588997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-7a410482-5a88-4ea3-85af-e8f74a749692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:39.590553 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 376/748] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:39.591408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a410482-5a88-4ea3-85af-e8f74a749692 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:39.613734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e5782-5166-4fdc-983c-368e838b8153 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:39.651876 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fa0df-857f-4ca2-99d5-7ddccb6d5811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:39.652810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fa0df-857f-4ca2-99d5-7ddccb6d5811 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.653224 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fa0df-857f-4ca2-99d5-7ddccb6d5811 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.653642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fa0df-857f-4ca2-99d5-7ddccb6d5811 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.654613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fa0df-857f-4ca2-99d5-7ddccb6d5811 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:39.655091 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fa0df-857f-4ca2-99d5-7ddccb6d5811 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:39.657308 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fa0df-857f-4ca2-99d5-7ddccb6d5811 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:39.675290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 373/749] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Feb 28 10:25:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:39.676160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fa0df-857f-4ca2-99d5-7ddccb6d5811 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:39.711938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a410482-5a88-4ea3-85af-e8f74a749692 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:39.748702 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d83df-9f90-4cd7-a7d4-cf17473d9547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:39.750015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d83df-9f90-4cd7-a7d4-cf17473d9547 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.750298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d83df-9f90-4cd7-a7d4-cf17473d9547 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.750567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d83df-9f90-4cd7-a7d4-cf17473d9547 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.758976 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d83df-9f90-4cd7-a7d4-cf17473d9547 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:39.760677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d83df-9f90-4cd7-a7d4-cf17473d9547 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:39.777259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-594d83df-9f90-4cd7-a7d4-cf17473d9547 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:25:39.778787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 377/750] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Feb 28 10:25:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:39.779691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d83df-9f90-4cd7-a7d4-cf17473d9547 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:39.797902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fa0df-857f-4ca2-99d5-7ddccb6d5811 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:39.831675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53804dc2-01bf-4a3e-a496-65686b53c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:39.832292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53804dc2-01bf-4a3e-a496-65686b53c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.832514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53804dc2-01bf-4a3e-a496-65686b53c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.834955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53804dc2-01bf-4a3e-a496-65686b53c9d5 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.834955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53804dc2-01bf-4a3e-a496-65686b53c9d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:39.834955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53804dc2-01bf-4a3e-a496-65686b53c9d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:39.835216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53804dc2-01bf-4a3e-a496-65686b53c9d5 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:39.850171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 374/751] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:39.850171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53804dc2-01bf-4a3e-a496-65686b53c9d5 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:39.883441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d83df-9f90-4cd7-a7d4-cf17473d9547 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:39.918344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18e11e-5aae-4e5f-9acb-bc90f8adea1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:39.919164 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18e11e-5aae-4e5f-9acb-bc90f8adea1a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.919454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18e11e-5aae-4e5f-9acb-bc90f8adea1a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.919747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18e11e-5aae-4e5f-9acb-bc90f8adea1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.930141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18e11e-5aae-4e5f-9acb-bc90f8adea1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:39.931619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18e11e-5aae-4e5f-9acb-bc90f8adea1a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:39.941152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53804dc2-01bf-4a3e-a496-65686b53c9d5 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:39.947914 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-0c18e11e-5aae-4e5f-9acb-bc90f8adea1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:39.953481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 378/752] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:39.953481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a58b-06b5-4016-ab9b-980c039296fc None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.953481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a58b-06b5-4016-ab9b-980c039296fc None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.953481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a58b-06b5-4016-ab9b-980c039296fc None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.953481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 379/753] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:39.953481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693a58b-06b5-4016-ab9b-980c039296fc None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:39.981878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce4a8a-7baa-40a4-811e-d186614be7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:39.982548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce4a8a-7baa-40a4-811e-d186614be7e7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:39.982840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce4a8a-7baa-40a4-811e-d186614be7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:39.983133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce4a8a-7baa-40a4-811e-d186614be7e7 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:39.984507 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce4a8a-7baa-40a4-811e-d186614be7e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:39.984813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce4a8a-7baa-40a4-811e-d186614be7e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:39.986237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce4a8a-7baa-40a4-811e-d186614be7e7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.006924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 375/754] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Feb 28 10:25:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:40.006924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce4a8a-7baa-40a4-811e-d186614be7e7 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.061957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693a58b-06b5-4016-ab9b-980c039296fc None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:40.098277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7bf42-70cd-4a83-a8eb-62a42b729b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:40.099093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7bf42-70cd-4a83-a8eb-62a42b729b47 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.099378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7bf42-70cd-4a83-a8eb-62a42b729b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.099653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7bf42-70cd-4a83-a8eb-62a42b729b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.106170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7bf42-70cd-4a83-a8eb-62a42b729b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:40.107642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7bf42-70cd-4a83-a8eb-62a42b729b47 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.109281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce4a8a-7baa-40a4-811e-d186614be7e7 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:40.120762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-66c7bf42-70cd-4a83-a8eb-62a42b729b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:40.126611 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 380/755] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:40.126611 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72170b-f584-48d9-9cd9-4bf1a269155a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.126611 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72170b-f584-48d9-9cd9-4bf1a269155a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.126611 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72170b-f584-48d9-9cd9-4bf1a269155a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.142896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-db72170b-f584-48d9-9cd9-4bf1a269155a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:40.144110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-db72170b-f584-48d9-9cd9-4bf1a269155a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:40.149043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5102a-986c-4da7-8d96-8d5d096df039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:40.149705 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5102a-986c-4da7-8d96-8d5d096df039 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.149982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5102a-986c-4da7-8d96-8d5d096df039 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.150252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5102a-986c-4da7-8d96-8d5d096df039 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.150988 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5102a-986c-4da7-8d96-8d5d096df039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:40.151298 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5102a-986c-4da7-8d96-8d5d096df039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:40.152654 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5102a-986c-4da7-8d96-8d5d096df039 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.168694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 376/756] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:40.168694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5102a-986c-4da7-8d96-8d5d096df039 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.214944 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 381/757] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:40.214944 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72170b-f584-48d9-9cd9-4bf1a269155a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.268851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5102a-986c-4da7-8d96-8d5d096df039 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:40.303920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236211e8-2616-45f5-9e52-654c69e22bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:40.304831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236211e8-2616-45f5-9e52-654c69e22bad None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.305256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236211e8-2616-45f5-9e52-654c69e22bad None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.305663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236211e8-2616-45f5-9e52-654c69e22bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.322623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72170b-f584-48d9-9cd9-4bf1a269155a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:40.358985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7beb644-aba1-45c5-b1eb-4520f96ca8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:40.359662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7beb644-aba1-45c5-b1eb-4520f96ca8c5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.359944 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7beb644-aba1-45c5-b1eb-4520f96ca8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.360222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7beb644-aba1-45c5-b1eb-4520f96ca8c5 None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.361004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7beb644-aba1-45c5-b1eb-4520f96ca8c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:40.361312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7beb644-aba1-45c5-b1eb-4520f96ca8c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:40.362737 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7beb644-aba1-45c5-b1eb-4520f96ca8c5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.379443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 382/758] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:40.379443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7beb644-aba1-45c5-b1eb-4520f96ca8c5 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.379971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236211e8-2616-45f5-9e52-654c69e22bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:40.381442 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236211e8-2616-45f5-9e52-654c69e22bad None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.469623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7beb644-aba1-45c5-b1eb-4520f96ca8c5 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:40.476356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 377/759] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:25:40.477343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236211e8-2616-45f5-9e52-654c69e22bad None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.503086 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab190d95-c0f0-4905-aa45-92e834b1e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:40.503880 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190d95-c0f0-4905-aa45-92e834b1e9ce None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.504158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190d95-c0f0-4905-aa45-92e834b1e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.504433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190d95-c0f0-4905-aa45-92e834b1e9ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.511294 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab190d95-c0f0-4905-aa45-92e834b1e9ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:40.512714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab190d95-c0f0-4905-aa45-92e834b1e9ce None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.525805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-ab190d95-c0f0-4905-aa45-92e834b1e9ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:40.527003 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 383/760] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:40.527777 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab190d95-c0f0-4905-aa45-92e834b1e9ce None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.576984 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236211e8-2616-45f5-9e52-654c69e22bad None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:40.610217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae17ecc-14bf-4c4d-85dc-00f45fbd570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:40.610966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae17ecc-14bf-4c4d-85dc-00f45fbd570d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.611243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae17ecc-14bf-4c4d-85dc-00f45fbd570d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.611505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae17ecc-14bf-4c4d-85dc-00f45fbd570d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.612144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae17ecc-14bf-4c4d-85dc-00f45fbd570d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:40.613508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae17ecc-14bf-4c4d-85dc-00f45fbd570d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.625015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-2ae17ecc-14bf-4c4d-85dc-00f45fbd570d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 10:25:40.631018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 378/761] 10.222.0.44 () {56 vars in 1129 bytes} [Mon Feb 28 10:25:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:40.631018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae17ecc-14bf-4c4d-85dc-00f45fbd570d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.631273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab190d95-c0f0-4905-aa45-92e834b1e9ce None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:40.664860 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90fd80-c049-410b-876e-319ccf979477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:40.665501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90fd80-c049-410b-876e-319ccf979477 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.665776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90fd80-c049-410b-876e-319ccf979477 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.666045 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90fd80-c049-410b-876e-319ccf979477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.666850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90fd80-c049-410b-876e-319ccf979477 None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=4f6db1c2542943928de6132ec9e61c84) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:40.667224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90fd80-c049-410b-876e-319ccf979477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:40.668669 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90fd80-c049-410b-876e-319ccf979477 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.683069 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 384/762] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:40 2022] GET /identity/v3/role_assignments?user.id=4f6db1c2542943928de6132ec9e61c84&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:40.683069 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90fd80-c049-410b-876e-319ccf979477 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.740793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae17ecc-14bf-4c4d-85dc-00f45fbd570d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:40.777387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dade1c-93ff-4422-9cf8-660fdfb9ec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:40.778279 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dade1c-93ff-4422-9cf8-660fdfb9ec38 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.778635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dade1c-93ff-4422-9cf8-660fdfb9ec38 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.779006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dade1c-93ff-4422-9cf8-660fdfb9ec38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.790478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dade1c-93ff-4422-9cf8-660fdfb9ec38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:40.792088 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dade1c-93ff-4422-9cf8-660fdfb9ec38 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.799254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90fd80-c049-410b-876e-319ccf979477 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:40.811071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-42dade1c-93ff-4422-9cf8-660fdfb9ec38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:40.817503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 379/763] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:40.818439 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dade1c-93ff-4422-9cf8-660fdfb9ec38 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.845474 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ed22f-a895-4f7d-a634-6812b1bff028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:40.846219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ed22f-a895-4f7d-a634-6812b1bff028 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.846565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ed22f-a895-4f7d-a634-6812b1bff028 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.846919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ed22f-a895-4f7d-a634-6812b1bff028 None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.847769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ed22f-a895-4f7d-a634-6812b1bff028 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:40.848197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ed22f-a895-4f7d-a634-6812b1bff028 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:40.849786 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ed22f-a895-4f7d-a634-6812b1bff028 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.862828 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 385/764] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:40.868521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ed22f-a895-4f7d-a634-6812b1bff028 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.922664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dade1c-93ff-4422-9cf8-660fdfb9ec38 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:40.956443 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169d6e1-822d-44d8-9e40-8a205459bea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:40.957108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d6e1-822d-44d8-9e40-8a205459bea0 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.957383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d6e1-822d-44d8-9e40-8a205459bea0 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.957653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d6e1-822d-44d8-9e40-8a205459bea0 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.958350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169d6e1-822d-44d8-9e40-8a205459bea0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:40.958651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169d6e1-822d-44d8-9e40-8a205459bea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:40.960108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169d6e1-822d-44d8-9e40-8a205459bea0 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.965175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 380/765] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Feb 28 10:25:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:40.965942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169d6e1-822d-44d8-9e40-8a205459bea0 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.978934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ed22f-a895-4f7d-a634-6812b1bff028 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:41.010939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb483e8d-046c-43e1-9101-6f340b45c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:41.011644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb483e8d-046c-43e1-9101-6f340b45c384 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:41.011962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb483e8d-046c-43e1-9101-6f340b45c384 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:41.012236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb483e8d-046c-43e1-9101-6f340b45c384 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:41.012998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb483e8d-046c-43e1-9101-6f340b45c384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:41.013297 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb483e8d-046c-43e1-9101-6f340b45c384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:41.014731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb483e8d-046c-43e1-9101-6f340b45c384 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:41.027243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 386/766] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:41.028078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb483e8d-046c-43e1-9101-6f340b45c384 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:41.074987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169d6e1-822d-44d8-9e40-8a205459bea0 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:41.115411 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554aeff-887e-47d0-89e8-a602bf5a4aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:41.116220 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554aeff-887e-47d0-89e8-a602bf5a4aa9 None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:41.116494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554aeff-887e-47d0-89e8-a602bf5a4aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:41.116791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554aeff-887e-47d0-89e8-a602bf5a4aa9 None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/b4132c15e66a4a619574f7aba10d6d71/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:41.118775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554aeff-887e-47d0-89e8-a602bf5a4aa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=b4132c15e66a4a619574f7aba10d6d71, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:41.120260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554aeff-887e-47d0-89e8-a602bf5a4aa9 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:41.135733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb483e8d-046c-43e1-9101-6f340b45c384 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:41.136666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 381/767] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:25:40 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/b4132c15e66a4a619574f7aba10d6d71/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:25:41.137536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554aeff-887e-47d0-89e8-a602bf5a4aa9 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:41.225482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06026b-928b-472a-9858-d1bb1450f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:41.226158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06026b-928b-472a-9858-d1bb1450f5ae None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:41.226434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06026b-928b-472a-9858-d1bb1450f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:41.226701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06026b-928b-472a-9858-d1bb1450f5ae None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:41.227445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06026b-928b-472a-9858-d1bb1450f5ae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:41.227747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06026b-928b-472a-9858-d1bb1450f5ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:41.229110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06026b-928b-472a-9858-d1bb1450f5ae None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:41.242948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 387/768] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Feb 28 10:25:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:41.248533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06026b-928b-472a-9858-d1bb1450f5ae None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:41.357802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554aeff-887e-47d0-89e8-a602bf5a4aa9 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:41.367985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06026b-928b-472a-9858-d1bb1450f5ae None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:41.407971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecf8a6-dda3-4c70-91f2-6fe35f02eb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:41.408936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecf8a6-dda3-4c70-91f2-6fe35f02eb83 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:41.410102 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecf8a6-dda3-4c70-91f2-6fe35f02eb83 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:41.410377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecf8a6-dda3-4c70-91f2-6fe35f02eb83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:41.414501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0083a-d484-44cc-a4e4-96b6434b6842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:41.415199 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0083a-d484-44cc-a4e4-96b6434b6842 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:41.415480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0083a-d484-44cc-a4e4-96b6434b6842 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:41.415752 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0083a-d484-44cc-a4e4-96b6434b6842 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:41.416546 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0083a-d484-44cc-a4e4-96b6434b6842 None admin] RBAC: Adding query filter params (interface=public, service_id=4a028ed035904ff98db6931887492fc8, region_id=RegionOne) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:41.416855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0083a-d484-44cc-a4e4-96b6434b6842 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:41.418300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecf8a6-dda3-4c70-91f2-6fe35f02eb83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:41.418524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0083a-d484-44cc-a4e4-96b6434b6842 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:41.419788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecf8a6-dda3-4c70-91f2-6fe35f02eb83 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:41.428665 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 388/769] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Feb 28 10:25:41 2022] GET /identity/v3/endpoints?service_id=4a028ed035904ff98db6931887492fc8&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:41.436165 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0083a-d484-44cc-a4e4-96b6434b6842 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:41.438892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-38ecf8a6-dda3-4c70-91f2-6fe35f02eb83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:41.440175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 382/770] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:41.445774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecf8a6-dda3-4c70-91f2-6fe35f02eb83 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:41.566929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0083a-d484-44cc-a4e4-96b6434b6842 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:41.595071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecf8a6-dda3-4c70-91f2-6fe35f02eb83 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:41.602924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df42a5-eecc-4dcc-94a1-97027afd7a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:41.602924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df42a5-eecc-4dcc-94a1-97027afd7a42 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:41.602924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df42a5-eecc-4dcc-94a1-97027afd7a42 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:41.602924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df42a5-eecc-4dcc-94a1-97027afd7a42 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:41.603270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df42a5-eecc-4dcc-94a1-97027afd7a42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:41.603270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df42a5-eecc-4dcc-94a1-97027afd7a42 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:41.615010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 389/771] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Feb 28 10:25:41 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:41.669549 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324916d-aa55-46c9-9aa1-c8dc36e3688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:41.670592 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324916d-aa55-46c9-9aa1-c8dc36e3688d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:41.671166 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324916d-aa55-46c9-9aa1-c8dc36e3688d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:41.671661 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324916d-aa55-46c9-9aa1-c8dc36e3688d None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:41.672699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324916d-aa55-46c9-9aa1-c8dc36e3688d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:41.673228 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324916d-aa55-46c9-9aa1-c8dc36e3688d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:41.674992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324916d-aa55-46c9-9aa1-c8dc36e3688d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:41.694644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 383/772] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:41.700690 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df42a5-eecc-4dcc-94a1-97027afd7a42 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:41.842789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21048d02-eb52-487a-8952-56c31d712943 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:41.843478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21048d02-eb52-487a-8952-56c31d712943 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:41.843957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21048d02-eb52-487a-8952-56c31d712943 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:41.845946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 384/773] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:25:41.850918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df42a5-eecc-4dcc-94a1-97027afd7a42 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:41.851546 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ef11c-e4df-4e80-860a-2afd191d5dc7 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:41.851831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ef11c-e4df-4e80-860a-2afd191d5dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:41.852105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ef11c-e4df-4e80-860a-2afd191d5dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:41.874806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-133ef11c-e4df-4e80-860a-2afd191d5dc7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:41.876568 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-133ef11c-e4df-4e80-860a-2afd191d5dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:41.887484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6da41b-5f43-4c26-8e43-7d0aff8f4873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:41.888392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6da41b-5f43-4c26-8e43-7d0aff8f4873 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:41.888842 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6da41b-5f43-4c26-8e43-7d0aff8f4873 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:41.889315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6da41b-5f43-4c26-8e43-7d0aff8f4873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:41.890844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6da41b-5f43-4c26-8e43-7d0aff8f4873 None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=642a67f2169944f29179e2a9a4f946b0) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:41.891350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6da41b-5f43-4c26-8e43-7d0aff8f4873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:41.892957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6da41b-5f43-4c26-8e43-7d0aff8f4873 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:41.898942 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 390/774] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:41 2022] GET /identity/v3/role_assignments?user.id=642a67f2169944f29179e2a9a4f946b0&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:41.957456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 385/775] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:25:41.982642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6da41b-5f43-4c26-8e43-7d0aff8f4873 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:42.121696 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6da41b-5f43-4c26-8e43-7d0aff8f4873 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:42.166705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bf103-f4c9-4bf0-9b68-6f5b82fc0d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:42.167516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bf103-f4c9-4bf0-9b68-6f5b82fc0d22 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:42.167791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bf103-f4c9-4bf0-9b68-6f5b82fc0d22 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:42.168058 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bf103-f4c9-4bf0-9b68-6f5b82fc0d22 None admin] PATH_INFO: `/v3/services/network` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:42.168697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bf103-f4c9-4bf0-9b68-6f5b82fc0d22 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:42.170186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bf103-f4c9-4bf0-9b68-6f5b82fc0d22 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:42.188409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-bf9bf103-f4c9-4bf0-9b68-6f5b82fc0d22 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 10:25:42.189617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 391/776] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:41 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:42.195510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ef11c-e4df-4e80-860a-2afd191d5dc7 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:42.336365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ef11c-e4df-4e80-860a-2afd191d5dc7 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:42.383630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80b6ab-32f6-403b-a92f-556ef6e95bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:42.384300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b6ab-32f6-403b-a92f-556ef6e95bd2 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:42.384577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b6ab-32f6-403b-a92f-556ef6e95bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:42.385100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b6ab-32f6-403b-a92f-556ef6e95bd2 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:42.385808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80b6ab-32f6-403b-a92f-556ef6e95bd2 None admin] RBAC: Adding query filter params (name=network) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:42.386110 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80b6ab-32f6-403b-a92f-556ef6e95bd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:42.387512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80b6ab-32f6-403b-a92f-556ef6e95bd2 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:42.394942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 386/777] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:25:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:42.400824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bf103-f4c9-4bf0-9b68-6f5b82fc0d22 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:42.548652 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bf103-f4c9-4bf0-9b68-6f5b82fc0d22 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:42.591183 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93521c-678d-4be4-ad3e-8db46f135212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:42.591760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93521c-678d-4be4-ad3e-8db46f135212 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:42.592037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93521c-678d-4be4-ad3e-8db46f135212 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:42.592307 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93521c-678d-4be4-ad3e-8db46f135212 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:42.593064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93521c-678d-4be4-ad3e-8db46f135212 None admin] RBAC: Adding query filter params (type=network) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:42.593367 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93521c-678d-4be4-ad3e-8db46f135212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:42.594710 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93521c-678d-4be4-ad3e-8db46f135212 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:42.602890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 392/778] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:25:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:42.608205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80b6ab-32f6-403b-a92f-556ef6e95bd2 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:42.744175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80b6ab-32f6-403b-a92f-556ef6e95bd2 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:42.777663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe12a5-e9a9-40b7-af1e-01b77fcb69be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:42.778323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe12a5-e9a9-40b7-af1e-01b77fcb69be None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:42.778599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe12a5-e9a9-40b7-af1e-01b77fcb69be None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:42.778870 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe12a5-e9a9-40b7-af1e-01b77fcb69be None admin] PATH_INFO: `/v3/endpoints` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:42.779683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe12a5-e9a9-40b7-af1e-01b77fcb69be None admin] RBAC: Adding query filter params (interface=public, service_id=645d56fe00364c0aa0c5f9bfc0fe0824, region_id=RegionOne) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:42.779990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe12a5-e9a9-40b7-af1e-01b77fcb69be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:42.781903 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe12a5-e9a9-40b7-af1e-01b77fcb69be None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:42.789535 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 387/779] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Feb 28 10:25:42 2022] GET /identity/v3/endpoints?service_id=645d56fe00364c0aa0c5f9bfc0fe0824&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:42.794781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93521c-678d-4be4-ad3e-8db46f135212 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:42.895019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93521c-678d-4be4-ad3e-8db46f135212 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:42.930924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e12772-7bec-4217-afbe-83e2d2b20131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:42.931603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e12772-7bec-4217-afbe-83e2d2b20131 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:42.931879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e12772-7bec-4217-afbe-83e2d2b20131 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:42.932149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e12772-7bec-4217-afbe-83e2d2b20131 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:42.932841 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e12772-7bec-4217-afbe-83e2d2b20131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:42.934241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e12772-7bec-4217-afbe-83e2d2b20131 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:42.941000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 393/780] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Feb 28 10:25:42 2022] GET /identity/v3/services => generated 772 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:43.333948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccac76f-e1ee-4847-b367-cacb70f67ce7 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:43.334426 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccac76f-e1ee-4847-b367-cacb70f67ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:43.334426 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccac76f-e1ee-4847-b367-cacb70f67ce7 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:43.336470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 388/781] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:43.341920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6503db-468f-4696-94d4-5ced97e4f853 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:43.342213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6503db-468f-4696-94d4-5ced97e4f853 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:43.342542 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6503db-468f-4696-94d4-5ced97e4f853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:43.359839 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-ba6503db-468f-4696-94d4-5ced97e4f853 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:43.361144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ba6503db-468f-4696-94d4-5ced97e4f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:43.440704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 394/782] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:43.477777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccac76f-e1ee-4847-b367-cacb70f67ce7 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:43.608104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccac76f-e1ee-4847-b367-cacb70f67ce7 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:43.656947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e5ca8-02d4-4331-8838-d0842f91d618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:43.657734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e5ca8-02d4-4331-8838-d0842f91d618 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:43.658012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e5ca8-02d4-4331-8838-d0842f91d618 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:43.658282 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e5ca8-02d4-4331-8838-d0842f91d618 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:43.675754 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e5ca8-02d4-4331-8838-d0842f91d618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:43.682444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-7b6e5ca8-02d4-4331-8838-d0842f91d618 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:25:43.684956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 389/783] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:43.690414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6503db-468f-4696-94d4-5ced97e4f853 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:43.801249 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6503db-468f-4696-94d4-5ced97e4f853 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:43.842414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aec4e-0f11-4262-8796-6384bae402ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:43.843631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aec4e-0f11-4262-8796-6384bae402ce None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:43.843909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aec4e-0f11-4262-8796-6384bae402ce None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:43.844179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aec4e-0f11-4262-8796-6384bae402ce None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:43.844922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aec4e-0f11-4262-8796-6384bae402ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:43.845225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aec4e-0f11-4262-8796-6384bae402ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:43.846580 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aec4e-0f11-4262-8796-6384bae402ce None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:43.855558 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 395/784] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:43.861074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e5ca8-02d4-4331-8838-d0842f91d618 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:44.011516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e5ca8-02d4-4331-8838-d0842f91d618 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:44.055931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3691f-4e26-455b-82e7-4b622ac63349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:44.057074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3691f-4e26-455b-82e7-4b622ac63349 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.057587 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3691f-4e26-455b-82e7-4b622ac63349 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.058063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3691f-4e26-455b-82e7-4b622ac63349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.075985 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3691f-4e26-455b-82e7-4b622ac63349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:44.088450 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3691f-4e26-455b-82e7-4b622ac63349 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:44.106685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-f5a3691f-4e26-455b-82e7-4b622ac63349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:44.109101 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 390/785] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:44.114625 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aec4e-0f11-4262-8796-6384bae402ce None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:44.134413 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc046be-7fcc-4202-b445-4c5dce383a89 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.135294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc046be-7fcc-4202-b445-4c5dce383a89 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.135800 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc046be-7fcc-4202-b445-4c5dce383a89 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.138116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 391/786] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:25:44.144167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a590d9-1f2b-4cf9-bd5f-80bf3fb90188 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.144730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a590d9-1f2b-4cf9-bd5f-80bf3fb90188 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.145227 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a590d9-1f2b-4cf9-bd5f-80bf3fb90188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.179918 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-62a590d9-1f2b-4cf9-bd5f-80bf3fb90188 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:44.181476 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-62a590d9-1f2b-4cf9-bd5f-80bf3fb90188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:44.226638 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aec4e-0f11-4262-8796-6384bae402ce None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:44.264061 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421a882-af2d-43f3-9aac-eb864af06929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:44.264778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421a882-af2d-43f3-9aac-eb864af06929 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.265042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421a882-af2d-43f3-9aac-eb864af06929 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.265317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421a882-af2d-43f3-9aac-eb864af06929 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.266030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421a882-af2d-43f3-9aac-eb864af06929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:44.266333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421a882-af2d-43f3-9aac-eb864af06929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:44.267709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421a882-af2d-43f3-9aac-eb864af06929 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:44.293930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 396/787] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:44.299022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421a882-af2d-43f3-9aac-eb864af06929 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:44.318420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 392/788] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:25:44.362511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a590d9-1f2b-4cf9-bd5f-80bf3fb90188 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:44.454738 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421a882-af2d-43f3-9aac-eb864af06929 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:44.474338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a590d9-1f2b-4cf9-bd5f-80bf3fb90188 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:44.510813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d743d-596d-4db8-8d85-4c9b5b58d070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:44.511639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d743d-596d-4db8-8d85-4c9b5b58d070 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.511918 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d743d-596d-4db8-8d85-4c9b5b58d070 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.512190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d743d-596d-4db8-8d85-4c9b5b58d070 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.522450 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d743d-596d-4db8-8d85-4c9b5b58d070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:44.529391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e89d743d-596d-4db8-8d85-4c9b5b58d070 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:25:44.531481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 393/789] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:44.536933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d743d-596d-4db8-8d85-4c9b5b58d070 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:44.544194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96ba2e-1d7c-44d5-a124-bb68d906e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:44.545207 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96ba2e-1d7c-44d5-a124-bb68d906e9ef None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.545637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96ba2e-1d7c-44d5-a124-bb68d906e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.546132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96ba2e-1d7c-44d5-a124-bb68d906e9ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.564002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96ba2e-1d7c-44d5-a124-bb68d906e9ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:44.565692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96ba2e-1d7c-44d5-a124-bb68d906e9ef None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:44.590462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-4f96ba2e-1d7c-44d5-a124-bb68d906e9ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:25:44.592289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 397/790] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:44.598061 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96ba2e-1d7c-44d5-a124-bb68d906e9ef None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:44.644612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d743d-596d-4db8-8d85-4c9b5b58d070 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:44.680715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8d01d-7bf7-4631-b78e-b4e0286a1e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:44.681469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d01d-7bf7-4631-b78e-b4e0286a1e01 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.681820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d01d-7bf7-4631-b78e-b4e0286a1e01 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.682469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d01d-7bf7-4631-b78e-b4e0286a1e01 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.683573 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8d01d-7bf7-4631-b78e-b4e0286a1e01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:44.683950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8d01d-7bf7-4631-b78e-b4e0286a1e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:44.685392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8d01d-7bf7-4631-b78e-b4e0286a1e01 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:44.694947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 394/791] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:44.701644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8d01d-7bf7-4631-b78e-b4e0286a1e01 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:44.773151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96ba2e-1d7c-44d5-a124-bb68d906e9ef None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:44.807342 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dfe08-0e30-48fd-b76d-37183757cf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:44.808001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dfe08-0e30-48fd-b76d-37183757cf0a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.808273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dfe08-0e30-48fd-b76d-37183757cf0a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.808555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dfe08-0e30-48fd-b76d-37183757cf0a None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.809376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dfe08-0e30-48fd-b76d-37183757cf0a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:44.809685 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dfe08-0e30-48fd-b76d-37183757cf0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:44.811123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dfe08-0e30-48fd-b76d-37183757cf0a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:44.829084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 398/792] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Feb 28 10:25:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:44.830461 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9d6e-3547-46f1-beeb-3830ff3b1c52 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.830746 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9d6e-3547-46f1-beeb-3830ff3b1c52 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.831056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9d6e-3547-46f1-beeb-3830ff3b1c52 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.832937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 399/793] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:44.834193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c9d6e-3547-46f1-beeb-3830ff3b1c52 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:44.854015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8d01d-7bf7-4631-b78e-b4e0286a1e01 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:44.888552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ac744-e153-4bf9-9980-ec04f88fc826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:44.889337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ac744-e153-4bf9-9980-ec04f88fc826 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.889654 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ac744-e153-4bf9-9980-ec04f88fc826 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.889932 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ac744-e153-4bf9-9980-ec04f88fc826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.900109 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ac744-e153-4bf9-9980-ec04f88fc826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:44.901541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ac744-e153-4bf9-9980-ec04f88fc826 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:44.917312 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-2d5ac744-e153-4bf9-9980-ec04f88fc826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:44.918495 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 395/794] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:44.919882 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbcd9b-97cf-4ce7-b5ad-bbc43e4cff14 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.919993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbcd9b-97cf-4ce7-b5ad-bbc43e4cff14 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.920237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbcd9b-97cf-4ce7-b5ad-bbc43e4cff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.938813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-54bbcd9b-97cf-4ce7-b5ad-bbc43e4cff14 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:44.940656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-54bbcd9b-97cf-4ce7-b5ad-bbc43e4cff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:44.944890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c9d6e-3547-46f1-beeb-3830ff3b1c52 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:44.977822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52892257-c535-473b-b7ff-d5cb00888ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:44.978597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892257-c535-473b-b7ff-d5cb00888ddf None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:44.978879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892257-c535-473b-b7ff-d5cb00888ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:44.979200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892257-c535-473b-b7ff-d5cb00888ddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:44.989633 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52892257-c535-473b-b7ff-d5cb00888ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:44.991203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52892257-c535-473b-b7ff-d5cb00888ddf None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.007838 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-52892257-c535-473b-b7ff-d5cb00888ddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:45.009001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 400/795] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:45.010458 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e651d-34a0-47ba-b41c-028fbbb3a608 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.010732 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e651d-34a0-47ba-b41c-028fbbb3a608 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.011030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e651d-34a0-47ba-b41c-028fbbb3a608 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.012829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 401/796] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:45.015908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e651d-34a0-47ba-b41c-028fbbb3a608 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.018093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 396/797] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:45.019219 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbcd9b-97cf-4ce7-b5ad-bbc43e4cff14 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.121205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e651d-34a0-47ba-b41c-028fbbb3a608 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.131792 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbcd9b-97cf-4ce7-b5ad-bbc43e4cff14 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.154190 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40283f76-3eee-42bf-a5ee-33aa810703b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.155013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40283f76-3eee-42bf-a5ee-33aa810703b4 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.155908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40283f76-3eee-42bf-a5ee-33aa810703b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.156184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40283f76-3eee-42bf-a5ee-33aa810703b4 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.156898 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40283f76-3eee-42bf-a5ee-33aa810703b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:45.157204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40283f76-3eee-42bf-a5ee-33aa810703b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:45.158562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40283f76-3eee-42bf-a5ee-33aa810703b4 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.164982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab2172-8ff0-4d56-a739-5fcee53d3bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.165643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab2172-8ff0-4d56-a739-5fcee53d3bfe None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.165925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab2172-8ff0-4d56-a739-5fcee53d3bfe None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.166199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab2172-8ff0-4d56-a739-5fcee53d3bfe None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.166931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab2172-8ff0-4d56-a739-5fcee53d3bfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:45.167239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab2172-8ff0-4d56-a739-5fcee53d3bfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:45.168599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab2172-8ff0-4d56-a739-5fcee53d3bfe None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.175418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 402/798] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:45.175418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe251d2-c81c-4c00-a7c2-99da167d1108 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.175418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe251d2-c81c-4c00-a7c2-99da167d1108 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.175418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe251d2-c81c-4c00-a7c2-99da167d1108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.185303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 397/799] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:45.186207 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab2172-8ff0-4d56-a739-5fcee53d3bfe None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.194074 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-cbe251d2-c81c-4c00-a7c2-99da167d1108 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:45.195331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cbe251d2-c81c-4c00-a7c2-99da167d1108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:45.270926 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 403/800] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:45.270926 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe251d2-c81c-4c00-a7c2-99da167d1108 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.297801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab2172-8ff0-4d56-a739-5fcee53d3bfe None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.331255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a72c4b-a65a-44eb-80c0-0178b19b81fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.332077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a72c4b-a65a-44eb-80c0-0178b19b81fd None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.332337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a72c4b-a65a-44eb-80c0-0178b19b81fd None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.332611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a72c4b-a65a-44eb-80c0-0178b19b81fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.344119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a72c4b-a65a-44eb-80c0-0178b19b81fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:45.350966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-77a72c4b-a65a-44eb-80c0-0178b19b81fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:45.356860 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 398/801] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:45.356860 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a72c4b-a65a-44eb-80c0-0178b19b81fd None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.371208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe251d2-c81c-4c00-a7c2-99da167d1108 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.406093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb57a1-6cfd-404f-b17a-252877b463c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.406868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb57a1-6cfd-404f-b17a-252877b463c9 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.407175 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb57a1-6cfd-404f-b17a-252877b463c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.407447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb57a1-6cfd-404f-b17a-252877b463c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.414206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb57a1-6cfd-404f-b17a-252877b463c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:45.415647 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb57a1-6cfd-404f-b17a-252877b463c9 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.429519 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-4edb57a1-6cfd-404f-b17a-252877b463c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:25:45.435285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 404/802] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:45.435285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb57a1-6cfd-404f-b17a-252877b463c9 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.451314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a72c4b-a65a-44eb-80c0-0178b19b81fd None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.483083 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e670c4-7213-44a5-abac-9c1139adaee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.484626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e670c4-7213-44a5-abac-9c1139adaee5 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.485079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e670c4-7213-44a5-abac-9c1139adaee5 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.485485 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e670c4-7213-44a5-abac-9c1139adaee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.492241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e670c4-7213-44a5-abac-9c1139adaee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:45.493697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e670c4-7213-44a5-abac-9c1139adaee5 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.507470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-b3e670c4-7213-44a5-abac-9c1139adaee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:45.513700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 399/803] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:45.513700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e670c4-7213-44a5-abac-9c1139adaee5 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.529963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb57a1-6cfd-404f-b17a-252877b463c9 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.563252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c0c53-84d6-4946-b012-cd3db4944a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.564048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0c53-84d6-4946-b012-cd3db4944a21 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.564325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0c53-84d6-4946-b012-cd3db4944a21 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.564600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0c53-84d6-4946-b012-cd3db4944a21 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.565245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c0c53-84d6-4946-b012-cd3db4944a21 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:45.566606 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c0c53-84d6-4946-b012-cd3db4944a21 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.578243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-9a7c0c53-84d6-4946-b012-cd3db4944a21 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 10:25:45.583221 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 405/804] 10.222.0.44 () {56 vars in 1129 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:45.584668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c0c53-84d6-4946-b012-cd3db4944a21 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.607364 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e670c4-7213-44a5-abac-9c1139adaee5 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.640267 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bb6fb-05d0-4f7c-aa62-9ea8b2b3217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.640923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb6fb-05d0-4f7c-aa62-9ea8b2b3217a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.641198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb6fb-05d0-4f7c-aa62-9ea8b2b3217a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.641470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb6fb-05d0-4f7c-aa62-9ea8b2b3217a None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.642190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bb6fb-05d0-4f7c-aa62-9ea8b2b3217a None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:45.642493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bb6fb-05d0-4f7c-aa62-9ea8b2b3217a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:45.643891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bb6fb-05d0-4f7c-aa62-9ea8b2b3217a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.651981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 400/805] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:45.655003 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bb6fb-05d0-4f7c-aa62-9ea8b2b3217a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.683442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c0c53-84d6-4946-b012-cd3db4944a21 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.715492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e45bac-efe2-41fb-bdaa-d33cd61f8b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.716147 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e45bac-efe2-41fb-bdaa-d33cd61f8b1a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.716427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e45bac-efe2-41fb-bdaa-d33cd61f8b1a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.716703 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e45bac-efe2-41fb-bdaa-d33cd61f8b1a None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.717522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e45bac-efe2-41fb-bdaa-d33cd61f8b1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:45.717862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e45bac-efe2-41fb-bdaa-d33cd61f8b1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:45.719306 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e45bac-efe2-41fb-bdaa-d33cd61f8b1a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.735923 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 406/806] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:45.736701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e45bac-efe2-41fb-bdaa-d33cd61f8b1a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.749713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bb6fb-05d0-4f7c-aa62-9ea8b2b3217a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.781281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a61fc-33ea-42d9-9f1e-1909c8eb5b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.781922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a61fc-33ea-42d9-9f1e-1909c8eb5b8f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.782193 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a61fc-33ea-42d9-9f1e-1909c8eb5b8f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.782459 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a61fc-33ea-42d9-9f1e-1909c8eb5b8f None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.783244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a61fc-33ea-42d9-9f1e-1909c8eb5b8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:45.783543 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a61fc-33ea-42d9-9f1e-1909c8eb5b8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:45.784954 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a61fc-33ea-42d9-9f1e-1909c8eb5b8f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.796263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 401/807] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:45.797024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a61fc-33ea-42d9-9f1e-1909c8eb5b8f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.829922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e45bac-efe2-41fb-bdaa-d33cd61f8b1a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.862197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec62a15-5eb4-4747-b695-93f6e7f167e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.862775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec62a15-5eb4-4747-b695-93f6e7f167e6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.863088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec62a15-5eb4-4747-b695-93f6e7f167e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.863359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec62a15-5eb4-4747-b695-93f6e7f167e6 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.864041 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec62a15-5eb4-4747-b695-93f6e7f167e6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:45.864343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec62a15-5eb4-4747-b695-93f6e7f167e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:45.865680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec62a15-5eb4-4747-b695-93f6e7f167e6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.869867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 407/808] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:45.871074 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1e700-a58d-4705-8161-b3a8006cbe26 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.871359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1e700-a58d-4705-8161-b3a8006cbe26 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.871632 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1e700-a58d-4705-8161-b3a8006cbe26 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.873220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 408/809] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:45.873948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1e700-a58d-4705-8161-b3a8006cbe26 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.888588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a61fc-33ea-42d9-9f1e-1909c8eb5b8f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.920297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54513a6b-b140-4b90-9668-7b2b73a398ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.921720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513a6b-b140-4b90-9668-7b2b73a398ba None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.922046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513a6b-b140-4b90-9668-7b2b73a398ba None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.922319 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513a6b-b140-4b90-9668-7b2b73a398ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.931749 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54513a6b-b140-4b90-9668-7b2b73a398ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:45.933176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54513a6b-b140-4b90-9668-7b2b73a398ba None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.949138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-54513a6b-b140-4b90-9668-7b2b73a398ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:45.950280 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 402/810] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:45.951075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54513a6b-b140-4b90-9668-7b2b73a398ba None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.969532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1e700-a58d-4705-8161-b3a8006cbe26 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:46.001621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d90f7-4068-47d8-aa51-63125626b4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:46.002246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d90f7-4068-47d8-aa51-63125626b4c4 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.002530 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d90f7-4068-47d8-aa51-63125626b4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.002802 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d90f7-4068-47d8-aa51-63125626b4c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.043868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54513a6b-b140-4b90-9668-7b2b73a398ba None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:46.065940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d90f7-4068-47d8-aa51-63125626b4c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:46.067431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d90f7-4068-47d8-aa51-63125626b4c4 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:46.075432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec3abe-727e-4e2e-99b3-513d543621e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:46.076297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec3abe-727e-4e2e-99b3-513d543621e8 None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.076573 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec3abe-727e-4e2e-99b3-513d543621e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.076842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec3abe-727e-4e2e-99b3-513d543621e8 None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/4f6db1c2542943928de6132ec9e61c84/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.078890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec3abe-727e-4e2e-99b3-513d543621e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=4f6db1c2542943928de6132ec9e61c84, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:46.080330 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec3abe-727e-4e2e-99b3-513d543621e8 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:46.095776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 403/811] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:25:45 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/4f6db1c2542943928de6132ec9e61c84/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:25:46.096568 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec3abe-727e-4e2e-99b3-513d543621e8 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:46.174436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 409/812] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:25:46.174436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedc67f-4424-4f2f-9d0b-86335710c4da None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.174436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedc67f-4424-4f2f-9d0b-86335710c4da None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.174436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedc67f-4424-4f2f-9d0b-86335710c4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.189904 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-deedc67f-4424-4f2f-9d0b-86335710c4da None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:46.191151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-deedc67f-4424-4f2f-9d0b-86335710c4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:46.206667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec3abe-727e-4e2e-99b3-513d543621e8 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:46.241786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5e350-b244-40df-a97e-2ec989f33250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:46.242455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5e350-b244-40df-a97e-2ec989f33250 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.242729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5e350-b244-40df-a97e-2ec989f33250 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.243027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5e350-b244-40df-a97e-2ec989f33250 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.243733 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5e350-b244-40df-a97e-2ec989f33250 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:46.244034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5e350-b244-40df-a97e-2ec989f33250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:46.245434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5e350-b244-40df-a97e-2ec989f33250 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:46.251367 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 404/813] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Feb 28 10:25:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:46.252212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5e350-b244-40df-a97e-2ec989f33250 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:46.265705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 410/814] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:46.266964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedc67f-4424-4f2f-9d0b-86335710c4da None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:46.353720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5e350-b244-40df-a97e-2ec989f33250 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:46.372812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedc67f-4424-4f2f-9d0b-86335710c4da None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:46.391334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497228f-37d3-47ed-9f60-a5f8a1c74023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:46.391990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497228f-37d3-47ed-9f60-a5f8a1c74023 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.392262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497228f-37d3-47ed-9f60-a5f8a1c74023 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.392526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497228f-37d3-47ed-9f60-a5f8a1c74023 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.393224 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497228f-37d3-47ed-9f60-a5f8a1c74023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:46.393521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497228f-37d3-47ed-9f60-a5f8a1c74023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:46.394878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497228f-37d3-47ed-9f60-a5f8a1c74023 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:46.406366 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 405/815] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:46.407184 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497228f-37d3-47ed-9f60-a5f8a1c74023 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:46.412545 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f5caf-7b5c-4caf-9982-586d4bc06650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:46.413339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5caf-7b5c-4caf-9982-586d4bc06650 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.413617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5caf-7b5c-4caf-9982-586d4bc06650 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.413890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5caf-7b5c-4caf-9982-586d4bc06650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.424192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f5caf-7b5c-4caf-9982-586d4bc06650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:46.425685 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f5caf-7b5c-4caf-9982-586d4bc06650 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:46.442298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-365f5caf-7b5c-4caf-9982-586d4bc06650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:46.443547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 411/816] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:46.444324 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f5caf-7b5c-4caf-9982-586d4bc06650 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:46.508259 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497228f-37d3-47ed-9f60-a5f8a1c74023 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:46.541038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ae91-549a-4d3a-baf5-b6666b8e0faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:46.541689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ae91-549a-4d3a-baf5-b6666b8e0faa None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.541965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ae91-549a-4d3a-baf5-b6666b8e0faa None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.542239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ae91-549a-4d3a-baf5-b6666b8e0faa None admin] PATH_INFO: `/v3/endpoints` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.542994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338ae91-549a-4d3a-baf5-b6666b8e0faa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:46.543349 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f5caf-7b5c-4caf-9982-586d4bc06650 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:46.544356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338ae91-549a-4d3a-baf5-b6666b8e0faa None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:46.565031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 406/817] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Feb 28 10:25:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:25:46.566232 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ae91-549a-4d3a-baf5-b6666b8e0faa None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:46.598416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff72de-e4d2-43ef-9fb8-db53d1e61ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:46.599624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff72de-e4d2-43ef-9fb8-db53d1e61ba3 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.600106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff72de-e4d2-43ef-9fb8-db53d1e61ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.600639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff72de-e4d2-43ef-9fb8-db53d1e61ba3 None admin] PATH_INFO: `/v3/services/network` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.601502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff72de-e4d2-43ef-9fb8-db53d1e61ba3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:46.603274 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff72de-e4d2-43ef-9fb8-db53d1e61ba3 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:46.615391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-dfff72de-e4d2-43ef-9fb8-db53d1e61ba3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 10:25:46.617265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 412/818] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:46 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:46.618270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff72de-e4d2-43ef-9fb8-db53d1e61ba3 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:46.674442 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ae91-549a-4d3a-baf5-b6666b8e0faa None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:46.710842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caf13b-f84e-4cc2-9ba8-3291b80c7cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:46.711704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf13b-f84e-4cc2-9ba8-3291b80c7cb6 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.711901 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf13b-f84e-4cc2-9ba8-3291b80c7cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.712159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf13b-f84e-4cc2-9ba8-3291b80c7cb6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.720551 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3caf13b-f84e-4cc2-9ba8-3291b80c7cb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:46.722032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3caf13b-f84e-4cc2-9ba8-3291b80c7cb6 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:46.731157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff72de-e4d2-43ef-9fb8-db53d1e61ba3 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:46.736742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-c3caf13b-f84e-4cc2-9ba8-3291b80c7cb6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:25:46.742791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 407/819] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Feb 28 10:25:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:46.743805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caf13b-f84e-4cc2-9ba8-3291b80c7cb6 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:46.771706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84edf-719f-4361-be1f-52748b08a3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:46.772417 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84edf-719f-4361-be1f-52748b08a3a5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.772695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84edf-719f-4361-be1f-52748b08a3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.773006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84edf-719f-4361-be1f-52748b08a3a5 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.773729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84edf-719f-4361-be1f-52748b08a3a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:46.774035 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84edf-719f-4361-be1f-52748b08a3a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:46.775428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84edf-719f-4361-be1f-52748b08a3a5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:46.788373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 413/820] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:46.789258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84edf-719f-4361-be1f-52748b08a3a5 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:46.852141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caf13b-f84e-4cc2-9ba8-3291b80c7cb6 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:46.886519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46de3a-092f-4244-8941-5db046e9db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:46.887595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46de3a-092f-4244-8941-5db046e9db07 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.888122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46de3a-092f-4244-8941-5db046e9db07 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.888613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46de3a-092f-4244-8941-5db046e9db07 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.889566 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46de3a-092f-4244-8941-5db046e9db07 None admin] RBAC: Adding query filter params (name=network) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:46.890553 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46de3a-092f-4244-8941-5db046e9db07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:46.892138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46de3a-092f-4244-8941-5db046e9db07 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:46.893850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84edf-719f-4361-be1f-52748b08a3a5 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:46.897863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 408/821] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:25:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:46.899012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46de3a-092f-4244-8941-5db046e9db07 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:46.928800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef511e0-6f0d-4800-a82e-8384e89df49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:46.929477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef511e0-6f0d-4800-a82e-8384e89df49e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:46.929758 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef511e0-6f0d-4800-a82e-8384e89df49e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:46.930034 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef511e0-6f0d-4800-a82e-8384e89df49e None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:46.930952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef511e0-6f0d-4800-a82e-8384e89df49e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:46.931256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef511e0-6f0d-4800-a82e-8384e89df49e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:46.932673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef511e0-6f0d-4800-a82e-8384e89df49e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:46.955038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 414/822] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Feb 28 10:25:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:46.955972 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef511e0-6f0d-4800-a82e-8384e89df49e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:47.001386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46de3a-092f-4244-8941-5db046e9db07 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:47.034674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6798a83-5493-4828-8b40-4aaab1a6218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:47.035486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6798a83-5493-4828-8b40-4aaab1a6218c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.035760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6798a83-5493-4828-8b40-4aaab1a6218c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.036025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6798a83-5493-4828-8b40-4aaab1a6218c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:47.042926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6798a83-5493-4828-8b40-4aaab1a6218c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:47.044425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6798a83-5493-4828-8b40-4aaab1a6218c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:47.057802 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef511e0-6f0d-4800-a82e-8384e89df49e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:47.058373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-b6798a83-5493-4828-8b40-4aaab1a6218c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:47.059885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 409/823] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:47.060665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6798a83-5493-4828-8b40-4aaab1a6218c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:47.100551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4dae-90a8-4262-941b-cd55a6a3b959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:47.101240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4dae-90a8-4262-941b-cd55a6a3b959 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.101493 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4dae-90a8-4262-941b-cd55a6a3b959 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.101764 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4dae-90a8-4262-941b-cd55a6a3b959 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:47.102460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4dae-90a8-4262-941b-cd55a6a3b959 None admin] RBAC: Adding query filter params (type=network) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:47.102761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4dae-90a8-4262-941b-cd55a6a3b959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:47.104142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4dae-90a8-4262-941b-cd55a6a3b959 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:47.110968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 415/824] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:25:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:47.112159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4dae-90a8-4262-941b-cd55a6a3b959 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:47.180292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6798a83-5493-4828-8b40-4aaab1a6218c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:47.214936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21921675-17c5-4d92-9fc3-86c2be96178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:47.215672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921675-17c5-4d92-9fc3-86c2be96178a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.215948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921675-17c5-4d92-9fc3-86c2be96178a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.216216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921675-17c5-4d92-9fc3-86c2be96178a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:47.226407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21921675-17c5-4d92-9fc3-86c2be96178a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:47.227890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21921675-17c5-4d92-9fc3-86c2be96178a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:47.242631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4dae-90a8-4262-941b-cd55a6a3b959 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:47.246260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-21921675-17c5-4d92-9fc3-86c2be96178a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:47.252160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 410/825] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:47.252160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21921675-17c5-4d92-9fc3-86c2be96178a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:47.281336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddea665-04dc-4414-a887-51175667dcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:47.281987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea665-04dc-4414-a887-51175667dcac None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.282263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea665-04dc-4414-a887-51175667dcac None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.282534 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea665-04dc-4414-a887-51175667dcac None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:47.283466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddea665-04dc-4414-a887-51175667dcac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:47.283769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddea665-04dc-4414-a887-51175667dcac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:47.285186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddea665-04dc-4414-a887-51175667dcac None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:47.301718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 416/826] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:47.302616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddea665-04dc-4414-a887-51175667dcac None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:47.378264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21921675-17c5-4d92-9fc3-86c2be96178a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:47.402680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddea665-04dc-4414-a887-51175667dcac None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:47.421548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa575d-fa10-4146-b2d7-74dce5054893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:47.422826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa575d-fa10-4146-b2d7-74dce5054893 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.423549 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa575d-fa10-4146-b2d7-74dce5054893 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.423975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa575d-fa10-4146-b2d7-74dce5054893 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:47.425036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa575d-fa10-4146-b2d7-74dce5054893 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:47.427216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa575d-fa10-4146-b2d7-74dce5054893 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:47.436814 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd27908-a00a-4010-824f-b61d42a73b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:47.437599 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd27908-a00a-4010-824f-b61d42a73b60 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.438265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd27908-a00a-4010-824f-b61d42a73b60 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.438541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd27908-a00a-4010-824f-b61d42a73b60 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:47.439332 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd27908-a00a-4010-824f-b61d42a73b60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:47.439591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd27908-a00a-4010-824f-b61d42a73b60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:47.440945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd27908-a00a-4010-824f-b61d42a73b60 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:47.453539 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 411/827] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Feb 28 10:25:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:25:47.454727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa575d-fa10-4146-b2d7-74dce5054893 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:47.459953 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 417/828] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:47.465481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd27908-a00a-4010-824f-b61d42a73b60 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:47.579727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa575d-fa10-4146-b2d7-74dce5054893 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:47.619976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd826-3dab-424c-be33-1f0f45071d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:47.621178 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd826-3dab-424c-be33-1f0f45071d9a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.621670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd826-3dab-424c-be33-1f0f45071d9a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.622139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd826-3dab-424c-be33-1f0f45071d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:47.623212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dd826-3dab-424c-be33-1f0f45071d9a None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=b4132c15e66a4a619574f7aba10d6d71) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:47.623723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dd826-3dab-424c-be33-1f0f45071d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:47.626290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dd826-3dab-424c-be33-1f0f45071d9a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:47.634075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 412/829] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:47 2022] GET /identity/v3/role_assignments?user.id=b4132c15e66a4a619574f7aba10d6d71&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:47.654159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd27908-a00a-4010-824f-b61d42a73b60 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:47.710617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317bb91-4d60-40c2-8745-38b983bed4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:47.711452 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317bb91-4d60-40c2-8745-38b983bed4dd None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.711729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317bb91-4d60-40c2-8745-38b983bed4dd None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.711997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317bb91-4d60-40c2-8745-38b983bed4dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:47.723078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317bb91-4d60-40c2-8745-38b983bed4dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:47.724621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317bb91-4d60-40c2-8745-38b983bed4dd None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:47.741558 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-d317bb91-4d60-40c2-8745-38b983bed4dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:47.747915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 418/830] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:47.749380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd826-3dab-424c-be33-1f0f45071d9a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:47.862258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd826-3dab-424c-be33-1f0f45071d9a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:47.898826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17058688-6967-42bd-a9da-5ee4cbb5899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:47.899848 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17058688-6967-42bd-a9da-5ee4cbb5899f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.900318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17058688-6967-42bd-a9da-5ee4cbb5899f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.900802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17058688-6967-42bd-a9da-5ee4cbb5899f None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:47.901776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17058688-6967-42bd-a9da-5ee4cbb5899f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:47.902272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17058688-6967-42bd-a9da-5ee4cbb5899f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:47.903928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17058688-6967-42bd-a9da-5ee4cbb5899f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:47.917542 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 413/831] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:47.924118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317bb91-4d60-40c2-8745-38b983bed4dd None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:48.027911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317bb91-4d60-40c2-8745-38b983bed4dd None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:48.061873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d8174-304c-4356-8545-54726cd05e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:48.063152 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8174-304c-4356-8545-54726cd05e2b None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:48.063629 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8174-304c-4356-8545-54726cd05e2b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:48.064120 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8174-304c-4356-8545-54726cd05e2b None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/642a67f2169944f29179e2a9a4f946b0/roles/19a2df51b7b646478ee4f4f466082cab` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:48.078807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d8174-304c-4356-8545-54726cd05e2b None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=642a67f2169944f29179e2a9a4f946b0, role_id=19a2df51b7b646478ee4f4f466082cab)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:48.080652 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d8174-304c-4356-8545-54726cd05e2b None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:48.101588 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 419/832] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:25:47 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/642a67f2169944f29179e2a9a4f946b0/roles/19a2df51b7b646478ee4f4f466082cab => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:25:48.482616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e3789-a26e-4d83-b2e8-43f99987a660 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:48.482958 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e3789-a26e-4d83-b2e8-43f99987a660 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:48.483230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e3789-a26e-4d83-b2e8-43f99987a660 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:48.485260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 414/833] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:48.490608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b903-c59e-4d26-bbd4-3d7e2a5e7a30 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:48.490919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b903-c59e-4d26-bbd4-3d7e2a5e7a30 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:48.491195 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b903-c59e-4d26-bbd4-3d7e2a5e7a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:48.508170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6966b903-c59e-4d26-bbd4-3d7e2a5e7a30 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:48.509338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6966b903-c59e-4d26-bbd4-3d7e2a5e7a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:48.576230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 420/834] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:48.601025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e3789-a26e-4d83-b2e8-43f99987a660 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:48.712011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e3789-a26e-4d83-b2e8-43f99987a660 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:48.745857 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9c026-8487-48e6-a642-5cec194016d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:48.746611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9c026-8487-48e6-a642-5cec194016d9 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:48.746886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9c026-8487-48e6-a642-5cec194016d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:48.747240 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9c026-8487-48e6-a642-5cec194016d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:48.758170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9c026-8487-48e6-a642-5cec194016d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:48.765244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-dfb9c026-8487-48e6-a642-5cec194016d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:25:48.766703 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 415/835] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:48.772719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966b903-c59e-4d26-bbd4-3d7e2a5e7a30 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:48.869956 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966b903-c59e-4d26-bbd4-3d7e2a5e7a30 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:48.904636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bfa71-0bdb-41d5-b214-9f0b706e900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:48.905670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bfa71-0bdb-41d5-b214-9f0b706e900c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:48.906151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bfa71-0bdb-41d5-b214-9f0b706e900c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:48.906637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bfa71-0bdb-41d5-b214-9f0b706e900c None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:48.907616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bfa71-0bdb-41d5-b214-9f0b706e900c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:48.908118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bfa71-0bdb-41d5-b214-9f0b706e900c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:48.909688 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bfa71-0bdb-41d5-b214-9f0b706e900c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:48.918827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 421/836] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:25:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:48.924664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9c026-8487-48e6-a642-5cec194016d9 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:48.963287 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a6dc-9d44-4121-a94a-cff7f5ef31ab None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:48.964266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a6dc-9d44-4121-a94a-cff7f5ef31ab None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:48.964756 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a6dc-9d44-4121-a94a-cff7f5ef31ab None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:48.967036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 422/837] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:25:48.973413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bee00-5f0e-4886-8f89-6ccb137baee4 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:48.973695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bee00-5f0e-4886-8f89-6ccb137baee4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:48.973971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bee00-5f0e-4886-8f89-6ccb137baee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:48.991435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-801bee00-5f0e-4886-8f89-6ccb137baee4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:48.992708 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-801bee00-5f0e-4886-8f89-6ccb137baee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:49.040578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9c026-8487-48e6-a642-5cec194016d9 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:49.063986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 423/838] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:25:49.085551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bee00-5f0e-4886-8f89-6ccb137baee4 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:49.092320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905e786-52f0-4240-bdd1-c0f06b065977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:49.094006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905e786-52f0-4240-bdd1-c0f06b065977 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:49.094502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905e786-52f0-4240-bdd1-c0f06b065977 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:49.095485 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905e786-52f0-4240-bdd1-c0f06b065977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:49.109074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905e786-52f0-4240-bdd1-c0f06b065977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:49.111563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905e786-52f0-4240-bdd1-c0f06b065977 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:49.132372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-b905e786-52f0-4240-bdd1-c0f06b065977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:49.134696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 416/839] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:49.140767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905e786-52f0-4240-bdd1-c0f06b065977 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:49.192093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bee00-5f0e-4886-8f89-6ccb137baee4 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:49.225969 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70a690-1bdf-497d-95d6-e934f0c8e8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:49.227137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a690-1bdf-497d-95d6-e934f0c8e8a1 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:49.227633 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a690-1bdf-497d-95d6-e934f0c8e8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:49.228111 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a690-1bdf-497d-95d6-e934f0c8e8a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:49.228943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70a690-1bdf-497d-95d6-e934f0c8e8a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:49.230490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70a690-1bdf-497d-95d6-e934f0c8e8a1 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:49.241955 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-5b70a690-1bdf-497d-95d6-e934f0c8e8a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 10:25:49.247832 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905e786-52f0-4240-bdd1-c0f06b065977 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:49.248408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 424/840] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:25:49.249512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70a690-1bdf-497d-95d6-e934f0c8e8a1 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:49.281316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18923e06-fd0d-4ec3-92d2-0706491d7f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:49.281975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923e06-fd0d-4ec3-92d2-0706491d7f68 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:49.282294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923e06-fd0d-4ec3-92d2-0706491d7f68 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:49.282570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923e06-fd0d-4ec3-92d2-0706491d7f68 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:49.283372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18923e06-fd0d-4ec3-92d2-0706491d7f68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:49.283673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18923e06-fd0d-4ec3-92d2-0706491d7f68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:49.285094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18923e06-fd0d-4ec3-92d2-0706491d7f68 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:49.302666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 417/841] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:49.303688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18923e06-fd0d-4ec3-92d2-0706491d7f68 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:49.351995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70a690-1bdf-497d-95d6-e934f0c8e8a1 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:49.387448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a3bde-15af-4d1f-bc8e-865920b6fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:49.388473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3bde-15af-4d1f-bc8e-865920b6fe99 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:49.388973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3bde-15af-4d1f-bc8e-865920b6fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:49.389475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3bde-15af-4d1f-bc8e-865920b6fe99 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:49.390373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a3bde-15af-4d1f-bc8e-865920b6fe99 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:49.390869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a3bde-15af-4d1f-bc8e-865920b6fe99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:49.392429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a3bde-15af-4d1f-bc8e-865920b6fe99 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:49.401966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 425/842] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:49.403121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a3bde-15af-4d1f-bc8e-865920b6fe99 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:49.410553 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18923e06-fd0d-4ec3-92d2-0706491d7f68 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:49.445646 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383be2f7-f634-42f1-bfb8-c8dd08c76ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:49.446434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383be2f7-f634-42f1-bfb8-c8dd08c76ae4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:49.446704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383be2f7-f634-42f1-bfb8-c8dd08c76ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:49.447000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383be2f7-f634-42f1-bfb8-c8dd08c76ae4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:49.454312 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383be2f7-f634-42f1-bfb8-c8dd08c76ae4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:49.455770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383be2f7-f634-42f1-bfb8-c8dd08c76ae4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:49.469748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-383be2f7-f634-42f1-bfb8-c8dd08c76ae4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:25:49.475478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 418/843] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:25:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:49.476368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383be2f7-f634-42f1-bfb8-c8dd08c76ae4 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:49.503972 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a3bde-15af-4d1f-bc8e-865920b6fe99 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:49.537957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203d82d-b7a8-4fb5-9428-3c41f8461fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:49.539024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203d82d-b7a8-4fb5-9428-3c41f8461fa3 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:49.539517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203d82d-b7a8-4fb5-9428-3c41f8461fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:49.539983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203d82d-b7a8-4fb5-9428-3c41f8461fa3 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:49.540878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203d82d-b7a8-4fb5-9428-3c41f8461fa3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:49.541415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203d82d-b7a8-4fb5-9428-3c41f8461fa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:49.542971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203d82d-b7a8-4fb5-9428-3c41f8461fa3 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:49.555315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 426/844] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:49.583046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383be2f7-f634-42f1-bfb8-c8dd08c76ae4 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:49.621840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f04d6-e909-45ef-8fe9-a85c50504011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:49.622600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f04d6-e909-45ef-8fe9-a85c50504011 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:49.622786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f04d6-e909-45ef-8fe9-a85c50504011 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:49.623079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f04d6-e909-45ef-8fe9-a85c50504011 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:49.623961 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f04d6-e909-45ef-8fe9-a85c50504011 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:49.624262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f04d6-e909-45ef-8fe9-a85c50504011 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:49.625697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f04d6-e909-45ef-8fe9-a85c50504011 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:49.645540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 419/845] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Feb 28 10:25:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:49.651269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203d82d-b7a8-4fb5-9428-3c41f8461fa3 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:49.757450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203d82d-b7a8-4fb5-9428-3c41f8461fa3 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:49.796334 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798e03-1726-4e8d-a2a4-5fa3b3e4ed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:49.797352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798e03-1726-4e8d-a2a4-5fa3b3e4ed09 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:49.797845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798e03-1726-4e8d-a2a4-5fa3b3e4ed09 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:49.798336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798e03-1726-4e8d-a2a4-5fa3b3e4ed09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:49.864397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23798e03-1726-4e8d-a2a4-5fa3b3e4ed09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:49.866160 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23798e03-1726-4e8d-a2a4-5fa3b3e4ed09 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:49.964798 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 427/846] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:25:49.971017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f04d6-e909-45ef-8fe9-a85c50504011 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:50.073432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f04d6-e909-45ef-8fe9-a85c50504011 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:50.109743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9f61-8a2f-424c-801f-1cd948d57eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:50.110570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9f61-8a2f-424c-801f-1cd948d57eca None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.110847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9f61-8a2f-424c-801f-1cd948d57eca None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.111143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9f61-8a2f-424c-801f-1cd948d57eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.122601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d9f61-8a2f-424c-801f-1cd948d57eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:50.124082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d9f61-8a2f-424c-801f-1cd948d57eca None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:50.141948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e96d9f61-8a2f-424c-801f-1cd948d57eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:50.143456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 420/847] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:50.149167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798e03-1726-4e8d-a2a4-5fa3b3e4ed09 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:50.249756 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798e03-1726-4e8d-a2a4-5fa3b3e4ed09 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:50.284441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2d3c5-4e3d-4a09-aa9e-fdee9cba7175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:50.285103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2d3c5-4e3d-4a09-aa9e-fdee9cba7175 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.285386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2d3c5-4e3d-4a09-aa9e-fdee9cba7175 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.285662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2d3c5-4e3d-4a09-aa9e-fdee9cba7175 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.286376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2d3c5-4e3d-4a09-aa9e-fdee9cba7175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:50.286678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2d3c5-4e3d-4a09-aa9e-fdee9cba7175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:50.288065 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2d3c5-4e3d-4a09-aa9e-fdee9cba7175 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:50.299843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 428/848] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:50.305301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9f61-8a2f-424c-801f-1cd948d57eca None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:50.355254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d91e-203b-4e89-af4d-efd17893bdeb None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.355575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d91e-203b-4e89-af4d-efd17893bdeb None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.355808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d91e-203b-4e89-af4d-efd17893bdeb None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.357827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 429/849] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:25:50.363044 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96880-ac79-4a45-a3d8-2ce1a4881995 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.363327 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96880-ac79-4a45-a3d8-2ce1a4881995 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.363608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96880-ac79-4a45-a3d8-2ce1a4881995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.381105 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-ffb96880-ac79-4a45-a3d8-2ce1a4881995 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:50.382213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ffb96880-ac79-4a45-a3d8-2ce1a4881995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:50.407552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9f61-8a2f-424c-801f-1cd948d57eca None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:50.447885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c004b9-90c3-4d65-8961-477c48068d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:50.448682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c004b9-90c3-4d65-8961-477c48068d4f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.449018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c004b9-90c3-4d65-8961-477c48068d4f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.449281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c004b9-90c3-4d65-8961-477c48068d4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.457771 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c004b9-90c3-4d65-8961-477c48068d4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:50.458206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 430/850] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:50.466947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c004b9-90c3-4d65-8961-477c48068d4f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:50.472454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-54c004b9-90c3-4d65-8961-477c48068d4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:50.472994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2373c8-b8f1-43ad-a0b0-292fe37f8d57 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.473473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2373c8-b8f1-43ad-a0b0-292fe37f8d57 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.473907 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 421/851] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:50.474182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2373c8-b8f1-43ad-a0b0-292fe37f8d57 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.478945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 431/852] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:25:50.480020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c004b9-90c3-4d65-8961-477c48068d4f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:50.481350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b8a53-f75a-4a10-826e-4f6d4969c2f1 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.481639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b8a53-f75a-4a10-826e-4f6d4969c2f1 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.481916 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b8a53-f75a-4a10-826e-4f6d4969c2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.500183 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-9c7b8a53-f75a-4a10-826e-4f6d4969c2f1 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:50.501405 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-9c7b8a53-f75a-4a10-826e-4f6d4969c2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:50.567231 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 432/853] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:50.567889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b8a53-f75a-4a10-826e-4f6d4969c2f1 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:50.587219 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c004b9-90c3-4d65-8961-477c48068d4f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:50.620436 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d69d2-1abb-46c6-8a6e-855a53a9b120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:50.621468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d69d2-1abb-46c6-8a6e-855a53a9b120 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.621848 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d69d2-1abb-46c6-8a6e-855a53a9b120 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.622122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d69d2-1abb-46c6-8a6e-855a53a9b120 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.622895 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d69d2-1abb-46c6-8a6e-855a53a9b120 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:50.623242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d69d2-1abb-46c6-8a6e-855a53a9b120 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:50.625159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d69d2-1abb-46c6-8a6e-855a53a9b120 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:50.643908 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 422/854] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:50.643908 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d69d2-1abb-46c6-8a6e-855a53a9b120 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:50.664320 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b8a53-f75a-4a10-826e-4f6d4969c2f1 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:50.698184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2b75-4893-497b-81fa-ce6363bad576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:50.699095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2b75-4893-497b-81fa-ce6363bad576 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.699400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2b75-4893-497b-81fa-ce6363bad576 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.699656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2b75-4893-497b-81fa-ce6363bad576 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.700309 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb2b75-4893-497b-81fa-ce6363bad576 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:50.701666 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb2b75-4893-497b-81fa-ce6363bad576 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:50.713315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-19bb2b75-4893-497b-81fa-ce6363bad576 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 10:25:50.719464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 433/855] 10.222.0.44 () {56 vars in 1132 bytes} [Mon Feb 28 10:25:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:50.719464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2b75-4893-497b-81fa-ce6363bad576 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:50.741262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d69d2-1abb-46c6-8a6e-855a53a9b120 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:50.774947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e067d9-414e-49f3-9d21-2ea0443d060a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:50.775745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e067d9-414e-49f3-9d21-2ea0443d060a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.776019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e067d9-414e-49f3-9d21-2ea0443d060a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.776287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e067d9-414e-49f3-9d21-2ea0443d060a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.786678 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e067d9-414e-49f3-9d21-2ea0443d060a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:50.793505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-c4e067d9-414e-49f3-9d21-2ea0443d060a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:25:50.794682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 423/856] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:25:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:50.796078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e067d9-414e-49f3-9d21-2ea0443d060a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:50.823530 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2b75-4893-497b-81fa-ce6363bad576 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:50.858841 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ccaf9-7190-49cd-a942-dacd8d6ffd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:50.859514 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ccaf9-7190-49cd-a942-dacd8d6ffd18 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.859793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ccaf9-7190-49cd-a942-dacd8d6ffd18 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.860069 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ccaf9-7190-49cd-a942-dacd8d6ffd18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.860891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ccaf9-7190-49cd-a942-dacd8d6ffd18 None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=4f6db1c2542943928de6132ec9e61c84) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:50.861202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ccaf9-7190-49cd-a942-dacd8d6ffd18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:50.862619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ccaf9-7190-49cd-a942-dacd8d6ffd18 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:50.878930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 434/857] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:50 2022] GET /identity/v3/role_assignments?user.id=4f6db1c2542943928de6132ec9e61c84&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:50.878930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ccaf9-7190-49cd-a942-dacd8d6ffd18 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:50.922852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e067d9-414e-49f3-9d21-2ea0443d060a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:50.969517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe36b-b773-4321-b190-7b8f1a79f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:50.970386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe36b-b773-4321-b190-7b8f1a79f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.971098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe36b-b773-4321-b190-7b8f1a79f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.971372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe36b-b773-4321-b190-7b8f1a79f8e1 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.972384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fe36b-b773-4321-b190-7b8f1a79f8e1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:50.972685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fe36b-b773-4321-b190-7b8f1a79f8e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:50.974642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fe36b-b773-4321-b190-7b8f1a79f8e1 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:50.979719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ccaf9-7190-49cd-a942-dacd8d6ffd18 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:50.980869 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 424/858] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Feb 28 10:25:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:50.986516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe36b-b773-4321-b190-7b8f1a79f8e1 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:51.027148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca4859-dccf-4c14-a42d-bffa77ce47a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:51.027962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca4859-dccf-4c14-a42d-bffa77ce47a9 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:51.028306 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca4859-dccf-4c14-a42d-bffa77ce47a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:51.028751 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca4859-dccf-4c14-a42d-bffa77ce47a9 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:51.030404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca4859-dccf-4c14-a42d-bffa77ce47a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:51.030709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca4859-dccf-4c14-a42d-bffa77ce47a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:51.032144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca4859-dccf-4c14-a42d-bffa77ce47a9 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:51.047019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 435/859] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:51.049733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca4859-dccf-4c14-a42d-bffa77ce47a9 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:51.119672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe36b-b773-4321-b190-7b8f1a79f8e1 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:51.154508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741ca4-06e1-4921-9a7a-d10d17b3389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:51.155739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741ca4-06e1-4921-9a7a-d10d17b3389d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:51.156015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741ca4-06e1-4921-9a7a-d10d17b3389d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:51.156281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741ca4-06e1-4921-9a7a-d10d17b3389d None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:51.156978 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9741ca4-06e1-4921-9a7a-d10d17b3389d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:51.157276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9741ca4-06e1-4921-9a7a-d10d17b3389d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:51.158630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9741ca4-06e1-4921-9a7a-d10d17b3389d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:51.163629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 425/860] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Feb 28 10:25:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:51.181619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca4859-dccf-4c14-a42d-bffa77ce47a9 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:51.219500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec82f38-255d-42be-a2e1-2d08ae0db27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:51.220311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec82f38-255d-42be-a2e1-2d08ae0db27c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:51.220586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec82f38-255d-42be-a2e1-2d08ae0db27c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:51.220856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec82f38-255d-42be-a2e1-2d08ae0db27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:51.233877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec82f38-255d-42be-a2e1-2d08ae0db27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:51.235441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec82f38-255d-42be-a2e1-2d08ae0db27c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:51.253289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-fec82f38-255d-42be-a2e1-2d08ae0db27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:51.255013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 436/861] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:51.260954 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741ca4-06e1-4921-9a7a-d10d17b3389d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:51.369348 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741ca4-06e1-4921-9a7a-d10d17b3389d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:51.402488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50125518-cb42-4143-91ff-dc2952a90edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:51.403172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50125518-cb42-4143-91ff-dc2952a90edf None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:51.403447 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50125518-cb42-4143-91ff-dc2952a90edf None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:51.403712 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50125518-cb42-4143-91ff-dc2952a90edf None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:51.404411 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50125518-cb42-4143-91ff-dc2952a90edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:51.404704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50125518-cb42-4143-91ff-dc2952a90edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:51.406674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50125518-cb42-4143-91ff-dc2952a90edf None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:51.418506 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 426/862] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:51.423871 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec82f38-255d-42be-a2e1-2d08ae0db27c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:51.527094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec82f38-255d-42be-a2e1-2d08ae0db27c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:51.560662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dabe3-2902-41f8-89de-6b15680852fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:51.561538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dabe3-2902-41f8-89de-6b15680852fd None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:51.561816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dabe3-2902-41f8-89de-6b15680852fd None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:51.562089 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dabe3-2902-41f8-89de-6b15680852fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:51.570778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dabe3-2902-41f8-89de-6b15680852fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:51.572296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dabe3-2902-41f8-89de-6b15680852fd None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:51.588037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-ad9dabe3-2902-41f8-89de-6b15680852fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:25:51.589632 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 437/863] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Feb 28 10:25:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:51.595914 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50125518-cb42-4143-91ff-dc2952a90edf None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:51.691926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50125518-cb42-4143-91ff-dc2952a90edf None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:51.734606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a574f62-9a8d-45ae-b811-6d589a3733a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:51.734606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574f62-9a8d-45ae-b811-6d589a3733a6 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:51.734606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574f62-9a8d-45ae-b811-6d589a3733a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:51.734606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574f62-9a8d-45ae-b811-6d589a3733a6 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:51.735033 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a574f62-9a8d-45ae-b811-6d589a3733a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:51.735033 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a574f62-9a8d-45ae-b811-6d589a3733a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:51.735033 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a574f62-9a8d-45ae-b811-6d589a3733a6 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:51.752739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 427/864] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Feb 28 10:25:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:51.757903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dabe3-2902-41f8-89de-6b15680852fd None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:51.858539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dabe3-2902-41f8-89de-6b15680852fd None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:51.892192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08ede-e089-41cb-b706-a45d9e2fdf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:51.893110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08ede-e089-41cb-b706-a45d9e2fdf39 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:51.893549 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08ede-e089-41cb-b706-a45d9e2fdf39 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:51.893975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08ede-e089-41cb-b706-a45d9e2fdf39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:51.942362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90713f67-3cb3-4871-be6d-6065f828af47 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:51.942652 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90713f67-3cb3-4871-be6d-6065f828af47 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:51.942946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90713f67-3cb3-4871-be6d-6065f828af47 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:51.945034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 428/865] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:51.952540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d1a9c-0e5a-4960-84a5-af9c3ceefb8b None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:51.953018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d1a9c-0e5a-4960-84a5-af9c3ceefb8b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:51.953509 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d1a9c-0e5a-4960-84a5-af9c3ceefb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:51.965718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e08ede-e089-41cb-b706-a45d9e2fdf39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:51.967928 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e08ede-e089-41cb-b706-a45d9e2fdf39 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:51.971108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-356d1a9c-0e5a-4960-84a5-af9c3ceefb8b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:51.972339 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-356d1a9c-0e5a-4960-84a5-af9c3ceefb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:52.051080 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 429/866] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:25:52.066137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d1a9c-0e5a-4960-84a5-af9c3ceefb8b None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:52.086764 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 438/867] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:25:52.092260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08ede-e089-41cb-b706-a45d9e2fdf39 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:52.192550 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d1a9c-0e5a-4960-84a5-af9c3ceefb8b None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:52.204467 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08ede-e089-41cb-b706-a45d9e2fdf39 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:52.232524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff32d11-d94c-451c-90c2-47ef899ef426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:52.233708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff32d11-d94c-451c-90c2-47ef899ef426 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:52.234039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff32d11-d94c-451c-90c2-47ef899ef426 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:52.234313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff32d11-d94c-451c-90c2-47ef899ef426 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:52.235048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff32d11-d94c-451c-90c2-47ef899ef426 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:52.236412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff32d11-d94c-451c-90c2-47ef899ef426 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:52.245407 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fa46f-b338-4183-82ae-04c090f0f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:52.246187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fa46f-b338-4183-82ae-04c090f0f716 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:52.246465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fa46f-b338-4183-82ae-04c090f0f716 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:52.246731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fa46f-b338-4183-82ae-04c090f0f716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:52.259519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 430/868] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:25:52 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:25:52.263790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fa46f-b338-4183-82ae-04c090f0f716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:52.265408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fa46f-b338-4183-82ae-04c090f0f716 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:52.284733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-548fa46f-b338-4183-82ae-04c090f0f716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:52.286428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 439/869] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:52.292030 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff32d11-d94c-451c-90c2-47ef899ef426 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:52.409023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff32d11-d94c-451c-90c2-47ef899ef426 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:52.445203 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68097176-4ece-4f3f-a1c1-db290b495756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:52.445852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68097176-4ece-4f3f-a1c1-db290b495756 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:52.446133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68097176-4ece-4f3f-a1c1-db290b495756 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:52.446405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68097176-4ece-4f3f-a1c1-db290b495756 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:52.447153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68097176-4ece-4f3f-a1c1-db290b495756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:52.447454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68097176-4ece-4f3f-a1c1-db290b495756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:52.448891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68097176-4ece-4f3f-a1c1-db290b495756 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:52.462194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 431/870] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:52.468500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fa46f-b338-4183-82ae-04c090f0f716 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:52.574007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fa46f-b338-4183-82ae-04c090f0f716 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:52.606873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e100b8-932d-4254-96cc-e6abe511232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:52.607710 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e100b8-932d-4254-96cc-e6abe511232a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:52.608012 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e100b8-932d-4254-96cc-e6abe511232a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:52.608820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e100b8-932d-4254-96cc-e6abe511232a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:52.615503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e100b8-932d-4254-96cc-e6abe511232a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:52.616986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e100b8-932d-4254-96cc-e6abe511232a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:52.630311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-04e100b8-932d-4254-96cc-e6abe511232a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:52.631812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 440/871] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:52.638060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68097176-4ece-4f3f-a1c1-db290b495756 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:52.736328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68097176-4ece-4f3f-a1c1-db290b495756 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:52.770954 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32991c41-b9e8-44b6-87bb-cf5474ad886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:52.771951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32991c41-b9e8-44b6-87bb-cf5474ad886d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:52.772423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32991c41-b9e8-44b6-87bb-cf5474ad886d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:52.772886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32991c41-b9e8-44b6-87bb-cf5474ad886d None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:52.773879 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32991c41-b9e8-44b6-87bb-cf5474ad886d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:52.774375 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32991c41-b9e8-44b6-87bb-cf5474ad886d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:52.776050 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32991c41-b9e8-44b6-87bb-cf5474ad886d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:52.788618 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 432/872] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:52.794850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e100b8-932d-4254-96cc-e6abe511232a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:52.894298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e100b8-932d-4254-96cc-e6abe511232a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:52.937186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c97589-3ed7-48e9-8cea-afb5ccf23574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:52.938199 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97589-3ed7-48e9-8cea-afb5ccf23574 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:52.938673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97589-3ed7-48e9-8cea-afb5ccf23574 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:52.939170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97589-3ed7-48e9-8cea-afb5ccf23574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:52.940218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c97589-3ed7-48e9-8cea-afb5ccf23574 None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=642a67f2169944f29179e2a9a4f946b0) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:52.940722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c97589-3ed7-48e9-8cea-afb5ccf23574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:52.942369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c97589-3ed7-48e9-8cea-afb5ccf23574 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:52.949390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 441/873] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:52 2022] GET /identity/v3/role_assignments?user.id=642a67f2169944f29179e2a9a4f946b0&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:53.305967 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1d5b-4d9d-482d-912b-a910379caf38 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:53.305967 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1d5b-4d9d-482d-912b-a910379caf38 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:53.305967 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1d5b-4d9d-482d-912b-a910379caf38 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:53.305967 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 433/874] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:53.312281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce209-af14-466a-a3f4-d9015dd3669e None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:53.313193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce209-af14-466a-a3f4-d9015dd3669e None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:53.313664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce209-af14-466a-a3f4-d9015dd3669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:53.334354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-872ce209-af14-466a-a3f4-d9015dd3669e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:53.335661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-872ce209-af14-466a-a3f4-d9015dd3669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:53.405218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 442/875] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:53.453127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed1d5b-4d9d-482d-912b-a910379caf38 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:53.601699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed1d5b-4d9d-482d-912b-a910379caf38 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:53.651428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bad43f-49ea-4f53-b937-df62a7d17c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:53.652238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bad43f-49ea-4f53-b937-df62a7d17c37 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:53.652515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bad43f-49ea-4f53-b937-df62a7d17c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:53.652784 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bad43f-49ea-4f53-b937-df62a7d17c37 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:53.653434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bad43f-49ea-4f53-b937-df62a7d17c37 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:53.654820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bad43f-49ea-4f53-b937-df62a7d17c37 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:53.668556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-d0bad43f-49ea-4f53-b937-df62a7d17c37 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 10:25:53.670304 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 434/876] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Feb 28 10:25:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:53.676256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce209-af14-466a-a3f4-d9015dd3669e None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:53.696630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648ca63-6777-4f57-8ea2-6f040547cb4c None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:53.697364 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648ca63-6777-4f57-8ea2-6f040547cb4c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:53.698052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648ca63-6777-4f57-8ea2-6f040547cb4c None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:53.706164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 435/877] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:53.708525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2acd-b500-413a-9db3-a04ec479e437 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:53.709013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2acd-b500-413a-9db3-a04ec479e437 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:53.709455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2acd-b500-413a-9db3-a04ec479e437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:53.734778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-49bb2acd-b500-413a-9db3-a04ec479e437 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:53.736242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-49bb2acd-b500-413a-9db3-a04ec479e437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:53.803769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce209-af14-466a-a3f4-d9015dd3669e None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:53.810994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 436/878] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:53.824429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb2acd-b500-413a-9db3-a04ec479e437 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:53.837997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d3872-b31a-468d-9ee2-d13598011c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:53.838739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d3872-b31a-468d-9ee2-d13598011c5f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:53.839165 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d3872-b31a-468d-9ee2-d13598011c5f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:53.839513 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d3872-b31a-468d-9ee2-d13598011c5f None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:53.840328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d3872-b31a-468d-9ee2-d13598011c5f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:53.840709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d3872-b31a-468d-9ee2-d13598011c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:53.842127 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d3872-b31a-468d-9ee2-d13598011c5f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:53.847252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 443/879] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Feb 28 10:25:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:53.852781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d3872-b31a-468d-9ee2-d13598011c5f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:53.923788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb2acd-b500-413a-9db3-a04ec479e437 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:53.952950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d3872-b31a-468d-9ee2-d13598011c5f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:53.958620 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935da4e-42aa-4103-a7b2-5db465205c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:53.959512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935da4e-42aa-4103-a7b2-5db465205c23 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:53.959929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935da4e-42aa-4103-a7b2-5db465205c23 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:53.960336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935da4e-42aa-4103-a7b2-5db465205c23 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:53.961328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935da4e-42aa-4103-a7b2-5db465205c23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:53.963151 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935da4e-42aa-4103-a7b2-5db465205c23 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:53.991422 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 437/880] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:25:53 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:25:54.010931 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54b0a-431b-4217-950d-00a6a7f83758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:54.011612 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54b0a-431b-4217-950d-00a6a7f83758 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:54.011890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54b0a-431b-4217-950d-00a6a7f83758 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:54.012161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54b0a-431b-4217-950d-00a6a7f83758 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:54.012866 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54b0a-431b-4217-950d-00a6a7f83758 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:54.013235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54b0a-431b-4217-950d-00a6a7f83758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:54.014735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54b0a-431b-4217-950d-00a6a7f83758 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:54.020362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 444/881] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Feb 28 10:25:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:54.786306 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69aa4-fbc9-4e2b-a832-0e7c78986e35 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:54.787132 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69aa4-fbc9-4e2b-a832-0e7c78986e35 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:54.787629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69aa4-fbc9-4e2b-a832-0e7c78986e35 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:54.789899 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 438/882] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:54.795556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f11d7-eaf9-47d8-927a-9da6b2b6e8b3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:54.796443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f11d7-eaf9-47d8-927a-9da6b2b6e8b3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:54.796944 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f11d7-eaf9-47d8-927a-9da6b2b6e8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:54.814580 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-668f11d7-eaf9-47d8-927a-9da6b2b6e8b3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:54.816127 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-668f11d7-eaf9-47d8-927a-9da6b2b6e8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:54.882991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 445/883] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:54.906046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69aa4-fbc9-4e2b-a832-0e7c78986e35 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:55.011074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69aa4-fbc9-4e2b-a832-0e7c78986e35 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:55.046171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5347c34-9c85-4c75-bf01-e5429aaad09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:55.047358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5347c34-9c85-4c75-bf01-e5429aaad09f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:55.047889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5347c34-9c85-4c75-bf01-e5429aaad09f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:55.048362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5347c34-9c85-4c75-bf01-e5429aaad09f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:55.049377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5347c34-9c85-4c75-bf01-e5429aaad09f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:55.051019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5347c34-9c85-4c75-bf01-e5429aaad09f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:55.063126 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-d5347c34-9c85-4c75-bf01-e5429aaad09f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 10:25:55.065011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 439/884] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:55.071171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f11d7-eaf9-47d8-927a-9da6b2b6e8b3 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:55.181222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f11d7-eaf9-47d8-927a-9da6b2b6e8b3 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:55.222698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f615d-0fd2-4674-8069-90186c9991a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:55.223397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f615d-0fd2-4674-8069-90186c9991a0 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:55.223677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f615d-0fd2-4674-8069-90186c9991a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:55.223950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f615d-0fd2-4674-8069-90186c9991a0 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:55.224659 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f615d-0fd2-4674-8069-90186c9991a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:55.224963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f615d-0fd2-4674-8069-90186c9991a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:55.226423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f615d-0fd2-4674-8069-90186c9991a0 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:55.231962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 446/885] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:55.237568 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5347c34-9c85-4c75-bf01-e5429aaad09f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:55.337581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5347c34-9c85-4c75-bf01-e5429aaad09f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:55.371556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d56929-3f0a-4d00-b6f5-f8ae6ba7cb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:55.372215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d56929-3f0a-4d00-b6f5-f8ae6ba7cb22 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:55.372505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d56929-3f0a-4d00-b6f5-f8ae6ba7cb22 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:55.372740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d56929-3f0a-4d00-b6f5-f8ae6ba7cb22 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:55.373434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d56929-3f0a-4d00-b6f5-f8ae6ba7cb22 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:55.373765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d56929-3f0a-4d00-b6f5-f8ae6ba7cb22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:55.375201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d56929-3f0a-4d00-b6f5-f8ae6ba7cb22 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:55.380276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 440/886] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:55.386151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f615d-0fd2-4674-8069-90186c9991a0 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:55.485132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f615d-0fd2-4674-8069-90186c9991a0 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:55.519539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf052ca-f9a1-4ba1-83a6-34258f4df968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:55.520187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf052ca-f9a1-4ba1-83a6-34258f4df968 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:55.520468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf052ca-f9a1-4ba1-83a6-34258f4df968 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:55.520741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf052ca-f9a1-4ba1-83a6-34258f4df968 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:55.521520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf052ca-f9a1-4ba1-83a6-34258f4df968 None admin] RBAC: Adding query filter params (interface=public, service_id=baad10e8e2c74bb5bbb471a129a610f4, region_id=RegionOne) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:55.521830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf052ca-f9a1-4ba1-83a6-34258f4df968 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:55.523203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf052ca-f9a1-4ba1-83a6-34258f4df968 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:55.528539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 447/887] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Feb 28 10:25:55 2022] GET /identity/v3/endpoints?service_id=baad10e8e2c74bb5bbb471a129a610f4&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:55.533957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d56929-3f0a-4d00-b6f5-f8ae6ba7cb22 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:55.555280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b7873-f1d1-42f6-bde6-ed278e3dfc37 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:55.555568 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b7873-f1d1-42f6-bde6-ed278e3dfc37 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:55.555830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b7873-f1d1-42f6-bde6-ed278e3dfc37 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:55.558445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 448/888] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:25:55.563769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38dff1-eacf-400d-8cd2-eb52796773c3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:55.564049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38dff1-eacf-400d-8cd2-eb52796773c3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:55.564495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38dff1-eacf-400d-8cd2-eb52796773c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:55.586056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-ef38dff1-eacf-400d-8cd2-eb52796773c3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:55.587564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ef38dff1-eacf-400d-8cd2-eb52796773c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:55.637026 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d56929-3f0a-4d00-b6f5-f8ae6ba7cb22 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:55.670333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb1ea1-9868-4297-be2a-4e9661ae5a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:55.671138 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 449/889] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:55.672023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1ea1-9868-4297-be2a-4e9661ae5a3b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:55.672477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1ea1-9868-4297-be2a-4e9661ae5a3b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:55.672887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1ea1-9868-4297-be2a-4e9661ae5a3b None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:55.673981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb1ea1-9868-4297-be2a-4e9661ae5a3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:55.682942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb1ea1-9868-4297-be2a-4e9661ae5a3b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:55.685829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 441/890] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Feb 28 10:25:55 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:25:55.696624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38dff1-eacf-400d-8cd2-eb52796773c3 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:55.808792 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38dff1-eacf-400d-8cd2-eb52796773c3 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:55.847457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af2be4-e5ed-4a68-a178-6d815640fbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:55.848654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af2be4-e5ed-4a68-a178-6d815640fbd5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:55.849146 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af2be4-e5ed-4a68-a178-6d815640fbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:55.849641 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af2be4-e5ed-4a68-a178-6d815640fbd5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:55.861663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af2be4-e5ed-4a68-a178-6d815640fbd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:25:55.869604 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-36af2be4-e5ed-4a68-a178-6d815640fbd5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:25:55.871440 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 450/891] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Feb 28 10:25:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:55.878826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb1ea1-9868-4297-be2a-4e9661ae5a3b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:55.978544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb1ea1-9868-4297-be2a-4e9661ae5a3b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:56.012086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529f53-c0b9-4c9e-bb1c-b37569ec3e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:56.012745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529f53-c0b9-4c9e-bb1c-b37569ec3e15 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.013018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529f53-c0b9-4c9e-bb1c-b37569ec3e15 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.013288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529f53-c0b9-4c9e-bb1c-b37569ec3e15 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:56.014017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529f53-c0b9-4c9e-bb1c-b37569ec3e15 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:56.014347 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529f53-c0b9-4c9e-bb1c-b37569ec3e15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:56.015730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529f53-c0b9-4c9e-bb1c-b37569ec3e15 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:56.024515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 442/892] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Feb 28 10:25:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:56.031501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af2be4-e5ed-4a68-a178-6d815640fbd5 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:56.141506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af2be4-e5ed-4a68-a178-6d815640fbd5 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:56.173879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e8723-dc7d-43a8-8513-4dd2a0a2b297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:56.174664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e8723-dc7d-43a8-8513-4dd2a0a2b297 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.174965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e8723-dc7d-43a8-8513-4dd2a0a2b297 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.175241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e8723-dc7d-43a8-8513-4dd2a0a2b297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:56.185720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e8723-dc7d-43a8-8513-4dd2a0a2b297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:56.187785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e8723-dc7d-43a8-8513-4dd2a0a2b297 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:56.204015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-2c9e8723-dc7d-43a8-8513-4dd2a0a2b297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:56.205505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 451/893] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:56.211018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529f53-c0b9-4c9e-bb1c-b37569ec3e15 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:56.307149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529f53-c0b9-4c9e-bb1c-b37569ec3e15 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:56.339295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cecfd-49c3-404a-b8a9-2500e18db2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:56.339950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cecfd-49c3-404a-b8a9-2500e18db2e1 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.340222 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cecfd-49c3-404a-b8a9-2500e18db2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.340491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cecfd-49c3-404a-b8a9-2500e18db2e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:56.341196 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cecfd-49c3-404a-b8a9-2500e18db2e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:56.341496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cecfd-49c3-404a-b8a9-2500e18db2e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:56.343425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cecfd-49c3-404a-b8a9-2500e18db2e1 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:56.355116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 443/894] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:56.360816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e8723-dc7d-43a8-8513-4dd2a0a2b297 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:56.435829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa3ea-6b82-4ab0-a858-7aae9cd6cbf0 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.437002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa3ea-6b82-4ab0-a858-7aae9cd6cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.437472 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa3ea-6b82-4ab0-a858-7aae9cd6cbf0 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:56.439743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 444/895] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:56.445021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ff745-95db-4bfe-914d-d746e00d2d14 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.445556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ff745-95db-4bfe-914d-d746e00d2d14 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.446034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ff745-95db-4bfe-914d-d746e00d2d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:56.461614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e8723-dc7d-43a8-8513-4dd2a0a2b297 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:56.465315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-b23ff745-95db-4bfe-914d-d746e00d2d14 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:56.466694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b23ff745-95db-4bfe-914d-d746e00d2d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:56.495651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed380c-467c-45c6-a780-de5d2d734468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:56.496760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed380c-467c-45c6-a780-de5d2d734468 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.497197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed380c-467c-45c6-a780-de5d2d734468 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.497474 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed380c-467c-45c6-a780-de5d2d734468 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:56.505077 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed380c-467c-45c6-a780-de5d2d734468 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:56.506575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed380c-467c-45c6-a780-de5d2d734468 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:56.520501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-84ed380c-467c-45c6-a780-de5d2d734468 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:25:56.526225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 452/896] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Feb 28 10:25:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:56.526225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88cfe5-8d0c-49c8-b4c5-a33066ade928 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.526225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88cfe5-8d0c-49c8-b4c5-a33066ade928 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.526225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88cfe5-8d0c-49c8-b4c5-a33066ade928 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:56.526225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 453/897] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:56.526974 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88cfe5-8d0c-49c8-b4c5-a33066ade928 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:56.547047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 445/898] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:56.548392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8168b-7653-4237-9108-10ab7d5bdd29 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.548672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8168b-7653-4237-9108-10ab7d5bdd29 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.548946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8168b-7653-4237-9108-10ab7d5bdd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:56.568300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-70d8168b-7653-4237-9108-10ab7d5bdd29 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:56.569479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-70d8168b-7653-4237-9108-10ab7d5bdd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:56.635501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88cfe5-8d0c-49c8-b4c5-a33066ade928 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:56.645217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 446/899] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:56.646209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8168b-7653-4237-9108-10ab7d5bdd29 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:56.679835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb729c9-5baa-4603-99b7-17de684c5af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:56.680494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb729c9-5baa-4603-99b7-17de684c5af5 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.680773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb729c9-5baa-4603-99b7-17de684c5af5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.681039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb729c9-5baa-4603-99b7-17de684c5af5 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:56.681863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb729c9-5baa-4603-99b7-17de684c5af5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:56.682166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb729c9-5baa-4603-99b7-17de684c5af5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:56.683604 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb729c9-5baa-4603-99b7-17de684c5af5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:56.704903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 454/900] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Feb 28 10:25:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:56.704903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb729c9-5baa-4603-99b7-17de684c5af5 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:56.759427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8168b-7653-4237-9108-10ab7d5bdd29 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:56.793941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3065b-4fc5-439f-a98b-d0aba220e3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:56.794741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3065b-4fc5-439f-a98b-d0aba220e3e7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.795050 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3065b-4fc5-439f-a98b-d0aba220e3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.795828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3065b-4fc5-439f-a98b-d0aba220e3e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:56.796482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3065b-4fc5-439f-a98b-d0aba220e3e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:56.797854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3065b-4fc5-439f-a98b-d0aba220e3e7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:56.803266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb729c9-5baa-4603-99b7-17de684c5af5 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:56.808791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e0a3065b-4fc5-439f-a98b-d0aba220e3e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 10:25:56.810095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 447/901] 10.222.0.44 () {56 vars in 1132 bytes} [Mon Feb 28 10:25:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:56.815164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3065b-4fc5-439f-a98b-d0aba220e3e7 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:56.838698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64df75-a08e-4e14-97b4-20a8c59d7475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:56.839316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64df75-a08e-4e14-97b4-20a8c59d7475 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.839597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64df75-a08e-4e14-97b4-20a8c59d7475 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.839867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64df75-a08e-4e14-97b4-20a8c59d7475 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:56.840583 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64df75-a08e-4e14-97b4-20a8c59d7475 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:56.841932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64df75-a08e-4e14-97b4-20a8c59d7475 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:56.855228 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 455/902] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:25:56 2022] POST /identity/v3/services => generated 241 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:25:56.856021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64df75-a08e-4e14-97b4-20a8c59d7475 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:56.939633 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3065b-4fc5-439f-a98b-d0aba220e3e7 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:56.983455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe87353-0a9e-40ea-86d0-90fd3b433fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:56.984761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64df75-a08e-4e14-97b4-20a8c59d7475 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:56.985012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe87353-0a9e-40ea-86d0-90fd3b433fc4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:56.985458 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe87353-0a9e-40ea-86d0-90fd3b433fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:56.985897 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe87353-0a9e-40ea-86d0-90fd3b433fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:57.021459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6c7af-da0a-4295-aa6c-9dc3e20e1293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:57.022123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6c7af-da0a-4295-aa6c-9dc3e20e1293 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:57.022405 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6c7af-da0a-4295-aa6c-9dc3e20e1293 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:57.022678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6c7af-da0a-4295-aa6c-9dc3e20e1293 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:57.023462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6c7af-da0a-4295-aa6c-9dc3e20e1293 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:57.023779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6c7af-da0a-4295-aa6c-9dc3e20e1293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:57.025222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6c7af-da0a-4295-aa6c-9dc3e20e1293 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:57.035557 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 456/903] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Feb 28 10:25:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:57.036809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6c7af-da0a-4295-aa6c-9dc3e20e1293 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:57.071504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe87353-0a9e-40ea-86d0-90fd3b433fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:57.072963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe87353-0a9e-40ea-86d0-90fd3b433fc4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:57.156424 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6c7af-da0a-4295-aa6c-9dc3e20e1293 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:57.192113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf1476-9a8c-4341-a2f2-af008cc63b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:57.193087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf1476-9a8c-4341-a2f2-af008cc63b7b None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:57.193554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf1476-9a8c-4341-a2f2-af008cc63b7b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:57.194008 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf1476-9a8c-4341-a2f2-af008cc63b7b None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:57.194895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf1476-9a8c-4341-a2f2-af008cc63b7b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:57.195432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf1476-9a8c-4341-a2f2-af008cc63b7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:57.197155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf1476-9a8c-4341-a2f2-af008cc63b7b None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:57.198754 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 448/904] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:25:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:25:57.203876 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe87353-0a9e-40ea-86d0-90fd3b433fc4 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:57.206137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 457/905] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Feb 28 10:25:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:57.211691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf1476-9a8c-4341-a2f2-af008cc63b7b None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:57.312682 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf1476-9a8c-4341-a2f2-af008cc63b7b None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:57.326099 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe87353-0a9e-40ea-86d0-90fd3b433fc4 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:57.351218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931e0df-f106-46c4-bee0-fcfa6e1433aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:57.352499 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e0df-f106-46c4-bee0-fcfa6e1433aa None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:57.352850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e0df-f106-46c4-bee0-fcfa6e1433aa None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:57.353447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e0df-f106-46c4-bee0-fcfa6e1433aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:57.354310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931e0df-f106-46c4-bee0-fcfa6e1433aa None admin] RBAC: Adding query filter params (interface=public, service_id=fd7594780aec47a6aa58608e5389289b, region_id=RegionOne) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:57.354841 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931e0df-f106-46c4-bee0-fcfa6e1433aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:57.356862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931e0df-f106-46c4-bee0-fcfa6e1433aa None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:57.365086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f323f93-1266-4d3e-b3e4-d19a4ff6e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:57.365554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 458/906] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Feb 28 10:25:57 2022] GET /identity/v3/endpoints?service_id=fd7594780aec47a6aa58608e5389289b&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:57.366509 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323f93-1266-4d3e-b3e4-d19a4ff6e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:57.366958 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323f93-1266-4d3e-b3e4-d19a4ff6e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:57.367374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323f93-1266-4d3e-b3e4-d19a4ff6e7d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:57.369689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931e0df-f106-46c4-bee0-fcfa6e1433aa None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:57.383243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f323f93-1266-4d3e-b3e4-d19a4ff6e7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:57.385445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f323f93-1266-4d3e-b3e4-d19a4ff6e7d5 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:57.407686 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-8f323f93-1266-4d3e-b3e4-d19a4ff6e7d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:25:57.410982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 449/907] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:57.414255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f323f93-1266-4d3e-b3e4-d19a4ff6e7d5 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:57.474458 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931e0df-f106-46c4-bee0-fcfa6e1433aa None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:57.508668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc901351-a896-4504-8df6-023b9420b2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:57.509232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc901351-a896-4504-8df6-023b9420b2ac None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:57.509519 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc901351-a896-4504-8df6-023b9420b2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:57.510053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc901351-a896-4504-8df6-023b9420b2ac None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:57.510780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc901351-a896-4504-8df6-023b9420b2ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:57.512187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc901351-a896-4504-8df6-023b9420b2ac None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:57.522938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 459/908] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Feb 28 10:25:57 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:25:57.539444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f323f93-1266-4d3e-b3e4-d19a4ff6e7d5 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:57.575791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b13df-ad02-4ee2-905f-f1cdd4dd7466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:57.576468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b13df-ad02-4ee2-905f-f1cdd4dd7466 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:57.577273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b13df-ad02-4ee2-905f-f1cdd4dd7466 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:57.577545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b13df-ad02-4ee2-905f-f1cdd4dd7466 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:57.578267 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b13df-ad02-4ee2-905f-f1cdd4dd7466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:57.578569 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b13df-ad02-4ee2-905f-f1cdd4dd7466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:57.579988 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b13df-ad02-4ee2-905f-f1cdd4dd7466 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:57.593236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 450/909] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:57.600103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc901351-a896-4504-8df6-023b9420b2ac None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:57.709929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc901351-a896-4504-8df6-023b9420b2ac None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:57.745353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76bf77-4938-41d7-b7c4-6e3a41723c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:57.746513 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76bf77-4938-41d7-b7c4-6e3a41723c72 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:57.747030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76bf77-4938-41d7-b7c4-6e3a41723c72 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:57.747500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76bf77-4938-41d7-b7c4-6e3a41723c72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:57.755463 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76bf77-4938-41d7-b7c4-6e3a41723c72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:57.757283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76bf77-4938-41d7-b7c4-6e3a41723c72 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:57.772583 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-bf76bf77-4938-41d7-b7c4-6e3a41723c72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:25:57.774531 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 460/910] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:57.781425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b13df-ad02-4ee2-905f-f1cdd4dd7466 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:57.881505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b13df-ad02-4ee2-905f-f1cdd4dd7466 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:57.915484 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c330a2-dd44-4643-bdbb-4d1240da0950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:57.916523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c330a2-dd44-4643-bdbb-4d1240da0950 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:57.917005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c330a2-dd44-4643-bdbb-4d1240da0950 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:57.917463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c330a2-dd44-4643-bdbb-4d1240da0950 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:57.918433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c330a2-dd44-4643-bdbb-4d1240da0950 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:57.918957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c330a2-dd44-4643-bdbb-4d1240da0950 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:57.920650 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c330a2-dd44-4643-bdbb-4d1240da0950 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:57.933187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 451/911] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:57.939776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76bf77-4938-41d7-b7c4-6e3a41723c72 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:58.037450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76bf77-4938-41d7-b7c4-6e3a41723c72 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:58.077178 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09658a44-577b-4818-9ce0-ee39fff1d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:58.078289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09658a44-577b-4818-9ce0-ee39fff1d444 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:58.078569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09658a44-577b-4818-9ce0-ee39fff1d444 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:58.078836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09658a44-577b-4818-9ce0-ee39fff1d444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:58.079694 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09658a44-577b-4818-9ce0-ee39fff1d444 None admin] RBAC: Adding query filter params (role.id=790bbad5bfa746499421af10c3bead87, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=642a67f2169944f29179e2a9a4f946b0) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:58.080000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09658a44-577b-4818-9ce0-ee39fff1d444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:58.081423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09658a44-577b-4818-9ce0-ee39fff1d444 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:58.087684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 461/912] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:25:57 2022] GET /identity/v3/role_assignments?user.id=642a67f2169944f29179e2a9a4f946b0&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=790bbad5bfa746499421af10c3bead87 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:58.134247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038308e3-8642-4a5c-83ca-a128a51e4dde None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:58.135049 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038308e3-8642-4a5c-83ca-a128a51e4dde None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:58.135143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038308e3-8642-4a5c-83ca-a128a51e4dde None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:58.137229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 452/913] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:58.143359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999a05d-5ae7-429c-a750-4c51432fabce None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:58.143647 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999a05d-5ae7-429c-a750-4c51432fabce None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:58.143926 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999a05d-5ae7-429c-a750-4c51432fabce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:58.162654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-9999a05d-5ae7-429c-a750-4c51432fabce None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:58.163870 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-9999a05d-5ae7-429c-a750-4c51432fabce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:58.235983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 462/914] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:58.258863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038308e3-8642-4a5c-83ca-a128a51e4dde None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:58.361790 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038308e3-8642-4a5c-83ca-a128a51e4dde None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:58.395722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5d24-5508-4624-9a45-7267dfd20840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:58.396518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5d24-5508-4624-9a45-7267dfd20840 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:58.396797 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5d24-5508-4624-9a45-7267dfd20840 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:58.397127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5d24-5508-4624-9a45-7267dfd20840 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:58.397775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d5d24-5508-4624-9a45-7267dfd20840 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:58.399235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d5d24-5508-4624-9a45-7267dfd20840 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:58.410989 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-b08d5d24-5508-4624-9a45-7267dfd20840 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 10:25:58.412581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 453/915] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:58.420057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999a05d-5ae7-429c-a750-4c51432fabce None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:58.522385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999a05d-5ae7-429c-a750-4c51432fabce None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:58.557271 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda75970-0372-4335-a263-3fedc93a2d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:58.557929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75970-0372-4335-a263-3fedc93a2d78 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:58.558213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75970-0372-4335-a263-3fedc93a2d78 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:58.558488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75970-0372-4335-a263-3fedc93a2d78 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:58.559209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda75970-0372-4335-a263-3fedc93a2d78 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:58.559516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda75970-0372-4335-a263-3fedc93a2d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:58.560897 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda75970-0372-4335-a263-3fedc93a2d78 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:58.566264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 463/916] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:58.571613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5d24-5508-4624-9a45-7267dfd20840 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:58.672305 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5d24-5508-4624-9a45-7267dfd20840 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:58.705192 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f67e6d-ef7c-4322-859e-602ee3a674b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:58.706196 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f67e6d-ef7c-4322-859e-602ee3a674b8 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:58.706666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f67e6d-ef7c-4322-859e-602ee3a674b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:58.707162 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f67e6d-ef7c-4322-859e-602ee3a674b8 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:58.708070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f67e6d-ef7c-4322-859e-602ee3a674b8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:58.708581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f67e6d-ef7c-4322-859e-602ee3a674b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:58.710137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f67e6d-ef7c-4322-859e-602ee3a674b8 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:58.715706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 454/917] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Feb 28 10:25:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:25:58.722088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda75970-0372-4335-a263-3fedc93a2d78 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:58.824091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda75970-0372-4335-a263-3fedc93a2d78 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:58.862463 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86080938-2158-4fcc-aad7-d82aceceba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:58.863144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86080938-2158-4fcc-aad7-d82aceceba3f None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:58.863431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86080938-2158-4fcc-aad7-d82aceceba3f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:58.863703 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86080938-2158-4fcc-aad7-d82aceceba3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:58.864447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86080938-2158-4fcc-aad7-d82aceceba3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:58.865806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86080938-2158-4fcc-aad7-d82aceceba3f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:58.888910 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 464/918] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Feb 28 10:25:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:25:59.276898 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4256-6f57-44a6-89ac-f2adfc14b01f None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:59.277423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4256-6f57-44a6-89ac-f2adfc14b01f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:59.277423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4256-6f57-44a6-89ac-f2adfc14b01f None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:59.279580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 455/919] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:59.286144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198be1c-7c89-4255-ba46-f50181d23ab3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:59.286676 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198be1c-7c89-4255-ba46-f50181d23ab3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:59.286676 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198be1c-7c89-4255-ba46-f50181d23ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:59.303725 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-1198be1c-7c89-4255-ba46-f50181d23ab3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:59.304911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-1198be1c-7c89-4255-ba46-f50181d23ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:59.380905 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 465/920] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:25:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:25:59.403107 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4256-6f57-44a6-89ac-f2adfc14b01f None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:59.505501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4256-6f57-44a6-89ac-f2adfc14b01f None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:59.538830 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a1b6a-c6c7-43cd-a2e7-17256c3c6314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:59.539649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a1b6a-c6c7-43cd-a2e7-17256c3c6314 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:59.539920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a1b6a-c6c7-43cd-a2e7-17256c3c6314 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:59.540186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a1b6a-c6c7-43cd-a2e7-17256c3c6314 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:59.540819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a1b6a-c6c7-43cd-a2e7-17256c3c6314 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:59.542221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a1b6a-c6c7-43cd-a2e7-17256c3c6314 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:59.553777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-9b2a1b6a-c6c7-43cd-a2e7-17256c3c6314 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 10:25:59.555260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 456/921] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Feb 28 10:25:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:25:59.561315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198be1c-7c89-4255-ba46-f50181d23ab3 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:59.667486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198be1c-7c89-4255-ba46-f50181d23ab3 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:59.702496 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e21f2-7b8a-4a4d-b668-c5ef121d9508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:59.703191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e21f2-7b8a-4a4d-b668-c5ef121d9508 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:59.703477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e21f2-7b8a-4a4d-b668-c5ef121d9508 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:59.703754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e21f2-7b8a-4a4d-b668-c5ef121d9508 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:59.704451 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e21f2-7b8a-4a4d-b668-c5ef121d9508 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:59.704761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e21f2-7b8a-4a4d-b668-c5ef121d9508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:59.706112 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e21f2-7b8a-4a4d-b668-c5ef121d9508 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:59.711326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 466/922] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Feb 28 10:25:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:59.716604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a1b6a-c6c7-43cd-a2e7-17256c3c6314 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:59.816555 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a1b6a-c6c7-43cd-a2e7-17256c3c6314 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:59.851773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1b5e8-10fa-4120-b42b-5e1c576a4de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:59.852429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1b5e8-10fa-4120-b42b-5e1c576a4de3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:59.852707 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1b5e8-10fa-4120-b42b-5e1c576a4de3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:59.852972 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1b5e8-10fa-4120-b42b-5e1c576a4de3 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:59.853666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1b5e8-10fa-4120-b42b-5e1c576a4de3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:25:59.853961 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1b5e8-10fa-4120-b42b-5e1c576a4de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:59.855341 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1b5e8-10fa-4120-b42b-5e1c576a4de3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:59.861019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 457/923] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Feb 28 10:25:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:25:59.866734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e21f2-7b8a-4a4d-b668-c5ef121d9508 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:59.965526 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e21f2-7b8a-4a4d-b668-c5ef121d9508 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:00.000268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d585e00-d123-4fed-a131-3df7aa9b49a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:00.000915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d585e00-d123-4fed-a131-3df7aa9b49a8 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.001191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d585e00-d123-4fed-a131-3df7aa9b49a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.001460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d585e00-d123-4fed-a131-3df7aa9b49a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.002238 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d585e00-d123-4fed-a131-3df7aa9b49a8 None admin] RBAC: Adding query filter params (interface=public, service_id=8ad4ea4f11a54d9fbaa7822aef2807a6, region_id=RegionOne) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:00.002544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d585e00-d123-4fed-a131-3df7aa9b49a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:00.003970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d585e00-d123-4fed-a131-3df7aa9b49a8 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:00.008732 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5196e1-1d26-469e-8009-fce94a4e024d None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.009013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5196e1-1d26-469e-8009-fce94a4e024d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.009288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5196e1-1d26-469e-8009-fce94a4e024d None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.011599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 458/924] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:26:00.014046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 467/925] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Feb 28 10:25:59 2022] GET /identity/v3/endpoints?service_id=8ad4ea4f11a54d9fbaa7822aef2807a6&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:00.017153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177cda3-92c1-4f5d-83f1-32c8d7273e09 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.017668 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177cda3-92c1-4f5d-83f1-32c8d7273e09 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.018128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177cda3-92c1-4f5d-83f1-32c8d7273e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.018406 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d585e00-d123-4fed-a131-3df7aa9b49a8 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:00.036317 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0177cda3-92c1-4f5d-83f1-32c8d7273e09 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:00.038205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0177cda3-92c1-4f5d-83f1-32c8d7273e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:00.127437 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 459/926] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:00.140298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d585e00-d123-4fed-a131-3df7aa9b49a8 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:00.153796 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177cda3-92c1-4f5d-83f1-32c8d7273e09 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:00.183896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad504ab0-708d-4ac2-8f5a-51c83b3e4190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:00.184912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad504ab0-708d-4ac2-8f5a-51c83b3e4190 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.185583 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad504ab0-708d-4ac2-8f5a-51c83b3e4190 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.187426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad504ab0-708d-4ac2-8f5a-51c83b3e4190 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.188328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad504ab0-708d-4ac2-8f5a-51c83b3e4190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:00.189968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad504ab0-708d-4ac2-8f5a-51c83b3e4190 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:00.202936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 468/927] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Feb 28 10:26:00 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:26:00.261404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177cda3-92c1-4f5d-83f1-32c8d7273e09 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:00.297987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637e41a-97f0-43b9-aa83-ceccac405382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:00.298801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637e41a-97f0-43b9-aa83-ceccac405382 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.299105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637e41a-97f0-43b9-aa83-ceccac405382 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.299370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637e41a-97f0-43b9-aa83-ceccac405382 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.300021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637e41a-97f0-43b9-aa83-ceccac405382 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:00.301400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637e41a-97f0-43b9-aa83-ceccac405382 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:00.313824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-9637e41a-97f0-43b9-aa83-ceccac405382 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 10:26:00.315433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 460/928] 10.222.0.44 () {56 vars in 1132 bytes} [Mon Feb 28 10:26:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:00.324322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad504ab0-708d-4ac2-8f5a-51c83b3e4190 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:00.434877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad504ab0-708d-4ac2-8f5a-51c83b3e4190 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:00.470155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bb78-c995-4d45-aa81-c34c3f491fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:00.471188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bb78-c995-4d45-aa81-c34c3f491fec None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.471717 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bb78-c995-4d45-aa81-c34c3f491fec None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.472197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bb78-c995-4d45-aa81-c34c3f491fec None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.473105 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52bb78-c995-4d45-aa81-c34c3f491fec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:00.473626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52bb78-c995-4d45-aa81-c34c3f491fec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:00.475209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52bb78-c995-4d45-aa81-c34c3f491fec None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:00.480550 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 469/929] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Feb 28 10:26:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:00.486652 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7b4e-fc88-41f4-be45-737e7e703ddd None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.486957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7b4e-fc88-41f4-be45-737e7e703ddd None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.487237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7b4e-fc88-41f4-be45-737e7e703ddd None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.487597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bb78-c995-4d45-aa81-c34c3f491fec None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:00.490160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 461/930] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:00.494117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef618c-260f-48f0-a5a9-142270a7709d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.494393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef618c-260f-48f0-a5a9-142270a7709d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.494662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef618c-260f-48f0-a5a9-142270a7709d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.511729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-73ef618c-260f-48f0-a5a9-142270a7709d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:00.512814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-73ef618c-260f-48f0-a5a9-142270a7709d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:00.602993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 462/931] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:00.609743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bb78-c995-4d45-aa81-c34c3f491fec None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:00.614347 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef618c-260f-48f0-a5a9-142270a7709d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:00.651087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a56dad-9a55-45b5-a727-c5024af549aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:00.651745 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a56dad-9a55-45b5-a727-c5024af549aa None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.652023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a56dad-9a55-45b5-a727-c5024af549aa None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.652292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a56dad-9a55-45b5-a727-c5024af549aa None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.653443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a56dad-9a55-45b5-a727-c5024af549aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:00.653443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a56dad-9a55-45b5-a727-c5024af549aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:00.654706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a56dad-9a55-45b5-a727-c5024af549aa None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:00.664142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 470/932] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Feb 28 10:26:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:00.665456 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a56dad-9a55-45b5-a727-c5024af549aa None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:00.735393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef618c-260f-48f0-a5a9-142270a7709d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:00.768992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49acd3-54ec-4565-9090-c7e6a7f591bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:00.769899 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49acd3-54ec-4565-9090-c7e6a7f591bf None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.770176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49acd3-54ec-4565-9090-c7e6a7f591bf None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.770443 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49acd3-54ec-4565-9090-c7e6a7f591bf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.771515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a56dad-9a55-45b5-a727-c5024af549aa None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:00.781386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49acd3-54ec-4565-9090-c7e6a7f591bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:26:00.788445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-fb49acd3-54ec-4565-9090-c7e6a7f591bf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:26:00.794469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 463/933] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Feb 28 10:26:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:00.795920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49acd3-54ec-4565-9090-c7e6a7f591bf None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:00.811537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3bd83-5a04-4c16-b50b-025223961b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:00.812789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3bd83-5a04-4c16-b50b-025223961b36 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.813474 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3bd83-5a04-4c16-b50b-025223961b36 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.813965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3bd83-5a04-4c16-b50b-025223961b36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.815393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3bd83-5a04-4c16-b50b-025223961b36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:00.817058 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3bd83-5a04-4c16-b50b-025223961b36 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:00.845569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 471/934] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Feb 28 10:26:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:26:00.923210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49acd3-54ec-4565-9090-c7e6a7f591bf None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:00.968622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659f170-8dad-4cfc-9ba9-693055a56715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:00.969716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659f170-8dad-4cfc-9ba9-693055a56715 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:00.969994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659f170-8dad-4cfc-9ba9-693055a56715 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:00.970261 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659f170-8dad-4cfc-9ba9-693055a56715 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:00.971042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659f170-8dad-4cfc-9ba9-693055a56715 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:00.971343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659f170-8dad-4cfc-9ba9-693055a56715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:00.972783 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659f170-8dad-4cfc-9ba9-693055a56715 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:00.988076 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 464/935] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Feb 28 10:26:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:00.992038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3bd83-5a04-4c16-b50b-025223961b36 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:01.105512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3bd83-5a04-4c16-b50b-025223961b36 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:01.140915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e3ac-18b0-4e84-922a-2e787ba71bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:01.141707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e3ac-18b0-4e84-922a-2e787ba71bb3 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:01.141987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e3ac-18b0-4e84-922a-2e787ba71bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:01.142258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e3ac-18b0-4e84-922a-2e787ba71bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:01.152909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e3ac-18b0-4e84-922a-2e787ba71bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:01.154389 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e3ac-18b0-4e84-922a-2e787ba71bb3 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:01.171484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-05e8e3ac-18b0-4e84-922a-2e787ba71bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:26:01.176650 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 472/936] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:01.178635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659f170-8dad-4cfc-9ba9-693055a56715 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:01.271947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536783d4-c872-4c3b-9813-db1254a49fd0 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:01.272419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536783d4-c872-4c3b-9813-db1254a49fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:01.272702 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536783d4-c872-4c3b-9813-db1254a49fd0 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:01.275542 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 473/937] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:26:01.282524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc0b9-32b4-463f-b49b-31ddc8271d76 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:01.282798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659f170-8dad-4cfc-9ba9-693055a56715 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:01.282922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc0b9-32b4-463f-b49b-31ddc8271d76 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:01.283126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc0b9-32b4-463f-b49b-31ddc8271d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:01.303375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e95cc0b9-32b4-463f-b49b-31ddc8271d76 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:01.304569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e95cc0b9-32b4-463f-b49b-31ddc8271d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:01.318365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387d57d-57c3-47df-936f-d0f12206b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:01.319057 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387d57d-57c3-47df-936f-d0f12206b04a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:01.319334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387d57d-57c3-47df-936f-d0f12206b04a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:01.319604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387d57d-57c3-47df-936f-d0f12206b04a None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:01.320313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387d57d-57c3-47df-936f-d0f12206b04a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:01.320611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387d57d-57c3-47df-936f-d0f12206b04a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:01.321964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387d57d-57c3-47df-936f-d0f12206b04a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:01.333863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 465/938] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:01.339450 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387d57d-57c3-47df-936f-d0f12206b04a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:01.380693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 474/939] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:01.404280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cc0b9-32b4-463f-b49b-31ddc8271d76 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:01.458612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387d57d-57c3-47df-936f-d0f12206b04a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:01.500921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f452c6-264b-4976-9cf1-6bc8c67e17e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:01.501773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f452c6-264b-4976-9cf1-6bc8c67e17e6 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:01.502054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f452c6-264b-4976-9cf1-6bc8c67e17e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:01.502322 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f452c6-264b-4976-9cf1-6bc8c67e17e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:01.509523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f452c6-264b-4976-9cf1-6bc8c67e17e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:01.511298 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f452c6-264b-4976-9cf1-6bc8c67e17e6 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:01.518223 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cc0b9-32b4-463f-b49b-31ddc8271d76 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:01.525155 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-b2f452c6-264b-4976-9cf1-6bc8c67e17e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:26:01.531594 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 466/940] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Feb 28 10:26:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:01.532750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f452c6-264b-4976-9cf1-6bc8c67e17e6 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:01.556667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d5010-abef-4a7c-a014-8f7016541be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:01.557635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d5010-abef-4a7c-a014-8f7016541be5 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:01.557919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d5010-abef-4a7c-a014-8f7016541be5 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:01.558456 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d5010-abef-4a7c-a014-8f7016541be5 None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:01.559182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d5010-abef-4a7c-a014-8f7016541be5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:01.561355 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d5010-abef-4a7c-a014-8f7016541be5 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:01.563207 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.common [None req-794d5010-abef-4a7c-a014-8f7016541be5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 28 10:26:01.586541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.sql.core [None req-794d5010-abef-4a7c-a014-8f7016541be5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 28 10:26:01.586541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 28 10:26:01.586541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [parameters: {'id': 'd92cfff6426f44a59592ee8d4cf8b48c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 28 10:26:01.586541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79326) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 10:26:01.594845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-794d5010-abef-4a7c-a014-8f7016541be5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d92cfff6426f44a59592ee8d4cf8b48c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d92cfff6426f44a59592ee8d4cf8b48c. Feb 28 10:26:01.598999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 475/941] 10.222.0.44 () {60 vars in 1140 bytes} [Mon Feb 28 10:26:01 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:01.602630 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d5010-abef-4a7c-a014-8f7016541be5 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:01.656899 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f452c6-264b-4976-9cf1-6bc8c67e17e6 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:01.699285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276fbdb-41bc-4e99-b638-a5f79dabbb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:01.700604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276fbdb-41bc-4e99-b638-a5f79dabbb6d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:01.701264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276fbdb-41bc-4e99-b638-a5f79dabbb6d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:01.702070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276fbdb-41bc-4e99-b638-a5f79dabbb6d None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:01.703399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276fbdb-41bc-4e99-b638-a5f79dabbb6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:01.704086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276fbdb-41bc-4e99-b638-a5f79dabbb6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:01.706295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276fbdb-41bc-4e99-b638-a5f79dabbb6d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:01.707475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d5010-abef-4a7c-a014-8f7016541be5 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:01.729673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 467/942] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Feb 28 10:26:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:01.735422 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276fbdb-41bc-4e99-b638-a5f79dabbb6d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:01.745103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2815fa3-6ac4-4fd0-b6f5-d31afe6d9408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:01.746640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2815fa3-6ac4-4fd0-b6f5-d31afe6d9408 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:01.747188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2815fa3-6ac4-4fd0-b6f5-d31afe6d9408 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:01.748029 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2815fa3-6ac4-4fd0-b6f5-d31afe6d9408 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:01.757675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2815fa3-6ac4-4fd0-b6f5-d31afe6d9408 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:01.759622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2815fa3-6ac4-4fd0-b6f5-d31afe6d9408 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:01.778211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-c2815fa3-6ac4-4fd0-b6f5-d31afe6d9408 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:26:01.786701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 476/943] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:01.788139 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2815fa3-6ac4-4fd0-b6f5-d31afe6d9408 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:01.845092 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276fbdb-41bc-4e99-b638-a5f79dabbb6d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:01.878871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734899d-d098-4733-9959-181db4f97b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:01.879680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734899d-d098-4733-9959-181db4f97b60 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:01.879955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734899d-d098-4733-9959-181db4f97b60 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:01.880221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734899d-d098-4733-9959-181db4f97b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:01.890925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2815fa3-6ac4-4fd0-b6f5-d31afe6d9408 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:01.891061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734899d-d098-4733-9959-181db4f97b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:01.894099 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734899d-d098-4733-9959-181db4f97b60 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:01.911683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-a734899d-d098-4733-9959-181db4f97b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:26:01.913214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 468/944] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:01.918508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734899d-d098-4733-9959-181db4f97b60 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:01.927646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8ade9-489e-4b9c-9e64-12311aab9bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:01.928302 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8ade9-489e-4b9c-9e64-12311aab9bc6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:01.928590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8ade9-489e-4b9c-9e64-12311aab9bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:01.928867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8ade9-489e-4b9c-9e64-12311aab9bc6 None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:01.929600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8ade9-489e-4b9c-9e64-12311aab9bc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:01.929904 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8ade9-489e-4b9c-9e64-12311aab9bc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:01.931348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8ade9-489e-4b9c-9e64-12311aab9bc6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:01.959395 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 477/945] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:26:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:02.034371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734899d-d098-4733-9959-181db4f97b60 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:02.072266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce6ed-e7b3-4c09-b857-96392e59e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:02.073290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce6ed-e7b3-4c09-b857-96392e59e348 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:02.073787 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce6ed-e7b3-4c09-b857-96392e59e348 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:02.074245 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce6ed-e7b3-4c09-b857-96392e59e348 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:02.075201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ce6ed-e7b3-4c09-b857-96392e59e348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:02.075698 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ce6ed-e7b3-4c09-b857-96392e59e348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:02.077845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ce6ed-e7b3-4c09-b857-96392e59e348 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:02.092778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 469/946] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:02.100517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8ade9-489e-4b9c-9e64-12311aab9bc6 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:02.205938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8ade9-489e-4b9c-9e64-12311aab9bc6 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:02.244241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16f603-6e62-4b3b-8a78-77b4cbe7aecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:02.245036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16f603-6e62-4b3b-8a78-77b4cbe7aecd None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:02.245318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16f603-6e62-4b3b-8a78-77b4cbe7aecd None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:02.245655 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16f603-6e62-4b3b-8a78-77b4cbe7aecd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:02.253191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16f603-6e62-4b3b-8a78-77b4cbe7aecd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:02.254624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16f603-6e62-4b3b-8a78-77b4cbe7aecd None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:02.268219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-2b16f603-6e62-4b3b-8a78-77b4cbe7aecd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:26:02.274379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 478/947] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:02.275850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce6ed-e7b3-4c09-b857-96392e59e348 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:02.375129 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce6ed-e7b3-4c09-b857-96392e59e348 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:02.409522 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f6ec1-cca0-4e7a-9c12-a29fd9c4577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:02.410531 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6ec1-cca0-4e7a-9c12-a29fd9c4577b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:02.411024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6ec1-cca0-4e7a-9c12-a29fd9c4577b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:02.411488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6ec1-cca0-4e7a-9c12-a29fd9c4577b None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:02.412465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f6ec1-cca0-4e7a-9c12-a29fd9c4577b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:02.412958 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f6ec1-cca0-4e7a-9c12-a29fd9c4577b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:02.414577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f6ec1-cca0-4e7a-9c12-a29fd9c4577b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:02.427367 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 470/948] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:02.435010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16f603-6e62-4b3b-8a78-77b4cbe7aecd None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:02.532622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16f603-6e62-4b3b-8a78-77b4cbe7aecd None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:02.566843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff7d3f-e90c-4ba1-99ac-a0fafc1c6209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:02.568263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7d3f-e90c-4ba1-99ac-a0fafc1c6209 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:02.568799 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7d3f-e90c-4ba1-99ac-a0fafc1c6209 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:02.569348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7d3f-e90c-4ba1-99ac-a0fafc1c6209 None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/642a67f2169944f29179e2a9a4f946b0/roles/790bbad5bfa746499421af10c3bead87` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:02.571908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff7d3f-e90c-4ba1-99ac-a0fafc1c6209 None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=642a67f2169944f29179e2a9a4f946b0, role_id=790bbad5bfa746499421af10c3bead87)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:02.573556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff7d3f-e90c-4ba1-99ac-a0fafc1c6209 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:02.584871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54844011-fa25-4a53-ac43-11c9458f5636 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:02.585163 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54844011-fa25-4a53-ac43-11c9458f5636 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:02.585422 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54844011-fa25-4a53-ac43-11c9458f5636 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:02.587360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 471/949] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:26:02.593192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 479/950] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:26:02 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/642a67f2169944f29179e2a9a4f946b0/roles/790bbad5bfa746499421af10c3bead87 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:26:02.594764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93354c71-c1b4-4b19-9ab4-cc83e7431fde None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:02.595304 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93354c71-c1b4-4b19-9ab4-cc83e7431fde None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:02.595827 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93354c71-c1b4-4b19-9ab4-cc83e7431fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:02.618751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-93354c71-c1b4-4b19-9ab4-cc83e7431fde None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:02.620005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-93354c71-c1b4-4b19-9ab4-cc83e7431fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:02.696016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 472/951] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:02.720290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff7d3f-e90c-4ba1-99ac-a0fafc1c6209 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:02.829089 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff7d3f-e90c-4ba1-99ac-a0fafc1c6209 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:02.862648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010285f1-2ce7-4725-95c9-84759e9f0984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:02.863477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010285f1-2ce7-4725-95c9-84759e9f0984 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:02.863758 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010285f1-2ce7-4725-95c9-84759e9f0984 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:02.864032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010285f1-2ce7-4725-95c9-84759e9f0984 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:02.864685 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010285f1-2ce7-4725-95c9-84759e9f0984 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:02.866049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010285f1-2ce7-4725-95c9-84759e9f0984 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:02.877573 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-010285f1-2ce7-4725-95c9-84759e9f0984 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 10:26:02.879136 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 480/952] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Feb 28 10:26:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:02.886938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93354c71-c1b4-4b19-9ab4-cc83e7431fde None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:02.984975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93354c71-c1b4-4b19-9ab4-cc83e7431fde None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:03.023101 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44825a4-c7ca-48b4-8125-a2f77334af6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:03.023761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44825a4-c7ca-48b4-8125-a2f77334af6b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:03.024037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44825a4-c7ca-48b4-8125-a2f77334af6b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:03.024302 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44825a4-c7ca-48b4-8125-a2f77334af6b None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:03.024996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44825a4-c7ca-48b4-8125-a2f77334af6b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:03.025291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44825a4-c7ca-48b4-8125-a2f77334af6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:03.026648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44825a4-c7ca-48b4-8125-a2f77334af6b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:03.031716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 473/953] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Feb 28 10:26:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:03.037279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010285f1-2ce7-4725-95c9-84759e9f0984 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:03.144378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010285f1-2ce7-4725-95c9-84759e9f0984 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:03.177960 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9c35d-5e21-4f4d-b296-c15224cd2f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:03.178658 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c35d-5e21-4f4d-b296-c15224cd2f39 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:03.178961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c35d-5e21-4f4d-b296-c15224cd2f39 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:03.179242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c35d-5e21-4f4d-b296-c15224cd2f39 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:03.179941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9c35d-5e21-4f4d-b296-c15224cd2f39 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:03.180245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9c35d-5e21-4f4d-b296-c15224cd2f39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:03.181596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9c35d-5e21-4f4d-b296-c15224cd2f39 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:03.187408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 481/954] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Feb 28 10:26:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:03.193082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44825a4-c7ca-48b4-8125-a2f77334af6b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:03.292801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44825a4-c7ca-48b4-8125-a2f77334af6b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:03.325568 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bb02f-8382-4628-b1c8-eea54303165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:03.326218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb02f-8382-4628-b1c8-eea54303165c None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:03.326598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb02f-8382-4628-b1c8-eea54303165c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:03.326869 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb02f-8382-4628-b1c8-eea54303165c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:03.327640 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bb02f-8382-4628-b1c8-eea54303165c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:03.328999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bb02f-8382-4628-b1c8-eea54303165c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:03.352297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 474/955] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Feb 28 10:26:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:26:03.364154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12327da0-f1ad-471b-9442-b35a62c6a5f0 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:03.364512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12327da0-f1ad-471b-9442-b35a62c6a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:03.364741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12327da0-f1ad-471b-9442-b35a62c6a5f0 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:03.367012 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 482/956] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:03.373216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606750d0-1a71-433b-8e25-1510a512fe1d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:03.373521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606750d0-1a71-433b-8e25-1510a512fe1d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:03.373782 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606750d0-1a71-433b-8e25-1510a512fe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:03.394125 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-606750d0-1a71-433b-8e25-1510a512fe1d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:03.395552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-606750d0-1a71-433b-8e25-1510a512fe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:03.476987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 475/957] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:03.499801 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12327da0-f1ad-471b-9442-b35a62c6a5f0 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:03.604449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12327da0-f1ad-471b-9442-b35a62c6a5f0 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:03.637285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877171-011a-4352-a44f-0ea04d4ad240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:03.638069 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877171-011a-4352-a44f-0ea04d4ad240 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:03.638344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877171-011a-4352-a44f-0ea04d4ad240 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:03.638616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877171-011a-4352-a44f-0ea04d4ad240 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:03.639816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95877171-011a-4352-a44f-0ea04d4ad240 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:03.641157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95877171-011a-4352-a44f-0ea04d4ad240 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:03.651954 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-95877171-011a-4352-a44f-0ea04d4ad240 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 10:26:03.653393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 483/958] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:26:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:03.659982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606750d0-1a71-433b-8e25-1510a512fe1d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:03.761250 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606750d0-1a71-433b-8e25-1510a512fe1d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:03.796454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2f2f7-1efd-454b-8c72-be1690ab7d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:03.797408 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2f2f7-1efd-454b-8c72-be1690ab7d89 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:03.797898 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2f2f7-1efd-454b-8c72-be1690ab7d89 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:03.798361 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2f2f7-1efd-454b-8c72-be1690ab7d89 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:03.799275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2f2f7-1efd-454b-8c72-be1690ab7d89 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:03.799756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2f2f7-1efd-454b-8c72-be1690ab7d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:03.801289 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2f2f7-1efd-454b-8c72-be1690ab7d89 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:03.806644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 476/959] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:26:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:03.812744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877171-011a-4352-a44f-0ea04d4ad240 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:03.914035 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877171-011a-4352-a44f-0ea04d4ad240 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:03.947512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba14a71-6deb-423c-8a4c-dfdc6802c529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:03.948457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14a71-6deb-423c-8a4c-dfdc6802c529 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:03.948951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14a71-6deb-423c-8a4c-dfdc6802c529 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:03.949406 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14a71-6deb-423c-8a4c-dfdc6802c529 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:03.950292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba14a71-6deb-423c-8a4c-dfdc6802c529 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:03.950777 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba14a71-6deb-423c-8a4c-dfdc6802c529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:03.952953 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba14a71-6deb-423c-8a4c-dfdc6802c529 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:03.960604 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 484/960] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:26:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:04.460086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc66c66-d910-4e9f-939a-f98073f7da38 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:04.461134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc66c66-d910-4e9f-939a-f98073f7da38 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:04.461613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc66c66-d910-4e9f-939a-f98073f7da38 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:04.463927 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 477/961] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:04.469538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffec85-4ce0-4a79-bfb7-13eb828aaa98 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:04.470068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffec85-4ce0-4a79-bfb7-13eb828aaa98 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:04.470545 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffec85-4ce0-4a79-bfb7-13eb828aaa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:04.488468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-43ffec85-4ce0-4a79-bfb7-13eb828aaa98 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:04.490313 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-43ffec85-4ce0-4a79-bfb7-13eb828aaa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:04.561282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 485/962] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:04.583353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc66c66-d910-4e9f-939a-f98073f7da38 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:04.690604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc66c66-d910-4e9f-939a-f98073f7da38 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:04.728124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7592a-8021-4f85-8f14-af40404e4866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:04.728718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7592a-8021-4f85-8f14-af40404e4866 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:04.728995 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7592a-8021-4f85-8f14-af40404e4866 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:04.729268 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7592a-8021-4f85-8f14-af40404e4866 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:04.729982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7592a-8021-4f85-8f14-af40404e4866 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:04.731448 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7592a-8021-4f85-8f14-af40404e4866 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:04.733336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.common [None req-88c7592a-8021-4f85-8f14-af40404e4866 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 28 10:26:04.747086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.sql.core [None req-88c7592a-8021-4f85-8f14-af40404e4866 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 28 10:26:04.747086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 28 10:26:04.747086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [parameters: {'user_id': '92fd77619e5647f19db2603c89272135', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 28 10:26:04.747086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79327) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 10:26:04.762822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-88c7592a-8021-4f85-8f14-af40404e4866 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 28 10:26:04.764636 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 478/963] 10.222.0.44 () {60 vars in 1131 bytes} [Mon Feb 28 10:26:04 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:04.770398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffec85-4ce0-4a79-bfb7-13eb828aaa98 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:04.868571 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffec85-4ce0-4a79-bfb7-13eb828aaa98 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:04.903019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9e5b-63b8-4bd4-82e8-b06b471d91b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:04.903813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9e5b-63b8-4bd4-82e8-b06b471d91b2 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:04.904094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9e5b-63b8-4bd4-82e8-b06b471d91b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:04.904395 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9e5b-63b8-4bd4-82e8-b06b471d91b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:04.911690 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e9e5b-63b8-4bd4-82e8-b06b471d91b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:04.913196 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e9e5b-63b8-4bd4-82e8-b06b471d91b2 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:04.927998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-7a0e9e5b-63b8-4bd4-82e8-b06b471d91b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 10:26:04.929465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 486/964] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:26:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:04.935479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7592a-8021-4f85-8f14-af40404e4866 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:05.039205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7592a-8021-4f85-8f14-af40404e4866 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:05.065592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a17b2-bc93-4655-a033-a091e44e8de3 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:05.066233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a17b2-bc93-4655-a033-a091e44e8de3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:05.066722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a17b2-bc93-4655-a033-a091e44e8de3 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:05.068965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 487/965] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:26:05.074025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3256-26f3-44d6-ac6e-b0c3f73f173e None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:05.074149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2930d5a-2cb4-4903-bc66-7052e2cd8909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:05.074646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3256-26f3-44d6-ac6e-b0c3f73f173e None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:05.074766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2930d5a-2cb4-4903-bc66-7052e2cd8909 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:05.075163 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2930d5a-2cb4-4903-bc66-7052e2cd8909 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:05.075482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3256-26f3-44d6-ac6e-b0c3f73f173e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:05.075581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2930d5a-2cb4-4903-bc66-7052e2cd8909 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:05.076324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2930d5a-2cb4-4903-bc66-7052e2cd8909 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:05.076632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2930d5a-2cb4-4903-bc66-7052e2cd8909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:05.079403 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2930d5a-2cb4-4903-bc66-7052e2cd8909 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:05.095933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-7f6b3256-26f3-44d6-ac6e-b0c3f73f173e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:05.097378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7f6b3256-26f3-44d6-ac6e-b0c3f73f173e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:05.119049 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 479/966] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Feb 28 10:26:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:05.171479 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 488/967] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:05.196416 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2930d5a-2cb4-4903-bc66-7052e2cd8909 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:05.300765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2930d5a-2cb4-4903-bc66-7052e2cd8909 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:05.339356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8e86e-6d70-4a2c-bd58-a6c0fad78a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:05.340524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8e86e-6d70-4a2c-bd58-a6c0fad78a6c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:05.340996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8e86e-6d70-4a2c-bd58-a6c0fad78a6c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:05.341468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8e86e-6d70-4a2c-bd58-a6c0fad78a6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:05.352241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8e86e-6d70-4a2c-bd58-a6c0fad78a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:26:05.360214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-5db8e86e-6d70-4a2c-bd58-a6c0fad78a6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:26:05.361910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 480/968] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Feb 28 10:26:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:05.367976 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3256-26f3-44d6-ac6e-b0c3f73f173e None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:05.473091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3256-26f3-44d6-ac6e-b0c3f73f173e None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:05.508210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36232cfc-161b-4b06-89ae-dd0a5d10608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:05.508870 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36232cfc-161b-4b06-89ae-dd0a5d10608d None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:05.509145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36232cfc-161b-4b06-89ae-dd0a5d10608d None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:05.509415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36232cfc-161b-4b06-89ae-dd0a5d10608d None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:05.510406 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36232cfc-161b-4b06-89ae-dd0a5d10608d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:05.510704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36232cfc-161b-4b06-89ae-dd0a5d10608d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:05.512181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36232cfc-161b-4b06-89ae-dd0a5d10608d None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:05.524648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 489/969] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Feb 28 10:26:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:05.525788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8e86e-6d70-4a2c-bd58-a6c0fad78a6c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:05.623183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8e86e-6d70-4a2c-bd58-a6c0fad78a6c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:05.655417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac0840-dd13-4da4-802f-e45ae80a0326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:05.656191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac0840-dd13-4da4-802f-e45ae80a0326 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:05.656464 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac0840-dd13-4da4-802f-e45ae80a0326 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:05.656729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac0840-dd13-4da4-802f-e45ae80a0326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:05.666769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac0840-dd13-4da4-802f-e45ae80a0326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:05.668243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac0840-dd13-4da4-802f-e45ae80a0326 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:05.684169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-b2ac0840-dd13-4da4-802f-e45ae80a0326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:26:05.685514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 481/970] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:05.690875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36232cfc-161b-4b06-89ae-dd0a5d10608d None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:05.787281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36232cfc-161b-4b06-89ae-dd0a5d10608d None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:05.818840 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1792d-5fac-4c70-8750-8e5834407be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:05.819521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1792d-5fac-4c70-8750-8e5834407be2 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:05.819802 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1792d-5fac-4c70-8750-8e5834407be2 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:05.820076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1792d-5fac-4c70-8750-8e5834407be2 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:05.820785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1792d-5fac-4c70-8750-8e5834407be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:05.821092 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1792d-5fac-4c70-8750-8e5834407be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:05.822439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1792d-5fac-4c70-8750-8e5834407be2 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:05.827674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a2390-0e23-4f46-9ae3-4e73dce4eaa5 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:05.827960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a2390-0e23-4f46-9ae3-4e73dce4eaa5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:05.828233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a2390-0e23-4f46-9ae3-4e73dce4eaa5 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:05.829995 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 482/971] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:05.834667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 490/972] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:05.835781 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f107-420b-49dd-b39b-fbc8e80cfbdf None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:05.836065 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f107-420b-49dd-b39b-fbc8e80cfbdf None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:05.836492 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f107-420b-49dd-b39b-fbc8e80cfbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:05.839823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1792d-5fac-4c70-8750-8e5834407be2 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:05.854168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e531f107-420b-49dd-b39b-fbc8e80cfbdf None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:05.855697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e531f107-420b-49dd-b39b-fbc8e80cfbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:05.920528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 483/973] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:05.937027 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1792d-5fac-4c70-8750-8e5834407be2 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:05.943316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531f107-420b-49dd-b39b-fbc8e80cfbdf None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:05.972474 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba620c10-36d1-4068-a4fd-6f54e677615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:05.973534 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620c10-36d1-4068-a4fd-6f54e677615e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:05.973807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620c10-36d1-4068-a4fd-6f54e677615e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:05.974076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620c10-36d1-4068-a4fd-6f54e677615e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:05.981110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba620c10-36d1-4068-a4fd-6f54e677615e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:05.982539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba620c10-36d1-4068-a4fd-6f54e677615e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:05.996657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-ba620c10-36d1-4068-a4fd-6f54e677615e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:26:05.997931 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 491/974] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Feb 28 10:26:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:06.004216 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba620c10-36d1-4068-a4fd-6f54e677615e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:06.050679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531f107-420b-49dd-b39b-fbc8e80cfbdf None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:06.090365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923515c-e46e-4b85-9f14-1820d7fb777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:06.091201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923515c-e46e-4b85-9f14-1820d7fb777c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.091480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923515c-e46e-4b85-9f14-1820d7fb777c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.091749 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923515c-e46e-4b85-9f14-1820d7fb777c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.092926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923515c-e46e-4b85-9f14-1820d7fb777c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:06.094287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923515c-e46e-4b85-9f14-1820d7fb777c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:06.105453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-b923515c-e46e-4b85-9f14-1820d7fb777c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 10:26:06.112236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba620c10-36d1-4068-a4fd-6f54e677615e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:06.112410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 484/975] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Feb 28 10:26:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:06.113358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923515c-e46e-4b85-9f14-1820d7fb777c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:06.143132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6a4d6-160f-4f34-ac21-f90417b6aa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:06.143795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6a4d6-160f-4f34-ac21-f90417b6aa78 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.144335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6a4d6-160f-4f34-ac21-f90417b6aa78 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.144335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6a4d6-160f-4f34-ac21-f90417b6aa78 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.145137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6a4d6-160f-4f34-ac21-f90417b6aa78 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:06.145442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6a4d6-160f-4f34-ac21-f90417b6aa78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:06.146873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6a4d6-160f-4f34-ac21-f90417b6aa78 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:06.163988 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 492/976] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Feb 28 10:26:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:06.169314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6a4d6-160f-4f34-ac21-f90417b6aa78 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:06.213739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923515c-e46e-4b85-9f14-1820d7fb777c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:06.250315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd3ad1-fc03-4cdb-b2fd-87ac46711173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:06.251339 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd3ad1-fc03-4cdb-b2fd-87ac46711173 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.251813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd3ad1-fc03-4cdb-b2fd-87ac46711173 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.252285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd3ad1-fc03-4cdb-b2fd-87ac46711173 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.253186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd3ad1-fc03-4cdb-b2fd-87ac46711173 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:06.253629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd3ad1-fc03-4cdb-b2fd-87ac46711173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:06.255148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd3ad1-fc03-4cdb-b2fd-87ac46711173 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:06.260289 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 485/977] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Feb 28 10:26:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:06.265813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd3ad1-fc03-4cdb-b2fd-87ac46711173 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:06.269682 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6a4d6-160f-4f34-ac21-f90417b6aa78 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:06.302804 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a92f5-7a29-412c-a4de-4eb598e0062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:06.303777 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a92f5-7a29-412c-a4de-4eb598e0062c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.304208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a92f5-7a29-412c-a4de-4eb598e0062c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.304474 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a92f5-7a29-412c-a4de-4eb598e0062c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.361372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd3ad1-fc03-4cdb-b2fd-87ac46711173 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:06.370407 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a92f5-7a29-412c-a4de-4eb598e0062c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:06.371886 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a92f5-7a29-412c-a4de-4eb598e0062c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:06.393644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23987a25-860b-4330-90e8-5558fb5d0631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:06.394295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987a25-860b-4330-90e8-5558fb5d0631 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.394575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987a25-860b-4330-90e8-5558fb5d0631 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.394845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987a25-860b-4330-90e8-5558fb5d0631 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.395572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23987a25-860b-4330-90e8-5558fb5d0631 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:06.395877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23987a25-860b-4330-90e8-5558fb5d0631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:06.397230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23987a25-860b-4330-90e8-5558fb5d0631 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:06.401809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 486/978] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Feb 28 10:26:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:06.403024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed327b5d-c383-4b1f-9193-7d0442057d1f None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.403311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed327b5d-c383-4b1f-9193-7d0442057d1f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.403586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed327b5d-c383-4b1f-9193-7d0442057d1f None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.405976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 487/979] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:06.410418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed327b5d-c383-4b1f-9193-7d0442057d1f None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:06.465927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 493/980] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:26:06 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:26:06.467805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd4902-5d9e-4a88-bf48-161569dcb5c8 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.468094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd4902-5d9e-4a88-bf48-161569dcb5c8 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.468368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd4902-5d9e-4a88-bf48-161569dcb5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.483909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-3ccd4902-5d9e-4a88-bf48-161569dcb5c8 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:06.485091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3ccd4902-5d9e-4a88-bf48-161569dcb5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:06.505589 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed327b5d-c383-4b1f-9193-7d0442057d1f None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:06.538092 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f19bf-17d6-45ba-a3a7-8f73581b6314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:06.538743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f19bf-17d6-45ba-a3a7-8f73581b6314 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.539054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f19bf-17d6-45ba-a3a7-8f73581b6314 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.539329 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f19bf-17d6-45ba-a3a7-8f73581b6314 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.540114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f19bf-17d6-45ba-a3a7-8f73581b6314 None admin] RBAC: Adding query filter params (interface=admin, service_id=8ad4ea4f11a54d9fbaa7822aef2807a6, region_id=RegionOne) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:06.540429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f19bf-17d6-45ba-a3a7-8f73581b6314 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:06.541815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f19bf-17d6-45ba-a3a7-8f73581b6314 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:06.546753 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 488/981] 10.222.0.44 () {56 vars in 1249 bytes} [Mon Feb 28 10:26:06 2022] GET /identity/v3/endpoints?service_id=8ad4ea4f11a54d9fbaa7822aef2807a6&interface=admin®ion_id=RegionOne => generated 193 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:06.547244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 494/982] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:06.547562 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f19bf-17d6-45ba-a3a7-8f73581b6314 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:06.553449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd4902-5d9e-4a88-bf48-161569dcb5c8 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:06.640890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f19bf-17d6-45ba-a3a7-8f73581b6314 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:06.649899 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd4902-5d9e-4a88-bf48-161569dcb5c8 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:06.672693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb235d-ec7d-443d-98be-0bf9dd71295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:06.673472 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb235d-ec7d-443d-98be-0bf9dd71295b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.673751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb235d-ec7d-443d-98be-0bf9dd71295b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.674017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb235d-ec7d-443d-98be-0bf9dd71295b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.682474 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451bde-938d-458a-9717-9f779c7d4c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:06.683152 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451bde-938d-458a-9717-9f779c7d4c37 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.683442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451bde-938d-458a-9717-9f779c7d4c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.683716 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451bde-938d-458a-9717-9f779c7d4c37 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.683905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb235d-ec7d-443d-98be-0bf9dd71295b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:06.684387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9451bde-938d-458a-9717-9f779c7d4c37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:06.685337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb235d-ec7d-443d-98be-0bf9dd71295b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:06.686347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9451bde-938d-458a-9717-9f779c7d4c37 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:06.692082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 495/983] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Feb 28 10:26:06 2022] GET /identity/v3/services => generated 1497 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:26:06.692825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451bde-938d-458a-9717-9f779c7d4c37 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:06.701689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-9cbb235d-ec7d-443d-98be-0bf9dd71295b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:26:06.702972 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 489/984] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:06.708839 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb235d-ec7d-443d-98be-0bf9dd71295b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:06.810525 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451bde-938d-458a-9717-9f779c7d4c37 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:06.812824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb235d-ec7d-443d-98be-0bf9dd71295b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:06.846274 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f3f2c-a413-4625-8aa9-f13e2341ddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:06.846969 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3f2c-a413-4625-8aa9-f13e2341ddbd None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.847260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3f2c-a413-4625-8aa9-f13e2341ddbd None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.847536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3f2c-a413-4625-8aa9-f13e2341ddbd None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.848270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f3f2c-a413-4625-8aa9-f13e2341ddbd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:06.849686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f3f2c-a413-4625-8aa9-f13e2341ddbd None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:06.849887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d0663-ddb1-406f-bbba-cd327702c565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:06.850715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d0663-ddb1-406f-bbba-cd327702c565 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:06.851195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d0663-ddb1-406f-bbba-cd327702c565 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:06.851633 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d0663-ddb1-406f-bbba-cd327702c565 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:06.852499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d0663-ddb1-406f-bbba-cd327702c565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:06.852961 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d0663-ddb1-406f-bbba-cd327702c565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:06.854649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d0663-ddb1-406f-bbba-cd327702c565 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:06.865374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 496/985] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:26:06 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:26:06.869041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 490/986] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:06.875211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f3f2c-a413-4625-8aa9-f13e2341ddbd None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:06.989708 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f3f2c-a413-4625-8aa9-f13e2341ddbd None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:07.024709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1a2a4-4b22-4bcd-a6be-7afaa62aa24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:07.025508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1a2a4-4b22-4bcd-a6be-7afaa62aa24f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:07.025783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1a2a4-4b22-4bcd-a6be-7afaa62aa24f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:07.026048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1a2a4-4b22-4bcd-a6be-7afaa62aa24f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:07.034060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1a2a4-4b22-4bcd-a6be-7afaa62aa24f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:07.035620 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1a2a4-4b22-4bcd-a6be-7afaa62aa24f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:07.050368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-27e1a2a4-4b22-4bcd-a6be-7afaa62aa24f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:26:07.051908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 497/987] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:07.057457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d0663-ddb1-406f-bbba-cd327702c565 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:07.156020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d0663-ddb1-406f-bbba-cd327702c565 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:07.187775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3757a8-1ccf-4f9b-a850-670a66c75a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:07.188430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3757a8-1ccf-4f9b-a850-670a66c75a8e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:07.188711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3757a8-1ccf-4f9b-a850-670a66c75a8e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:07.188978 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3757a8-1ccf-4f9b-a850-670a66c75a8e None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:07.189748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3757a8-1ccf-4f9b-a850-670a66c75a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:07.190051 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3757a8-1ccf-4f9b-a850-670a66c75a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:07.191501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3757a8-1ccf-4f9b-a850-670a66c75a8e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:07.203920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 491/988] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:07.209769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1a2a4-4b22-4bcd-a6be-7afaa62aa24f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:07.303838 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1a2a4-4b22-4bcd-a6be-7afaa62aa24f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:07.336001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a7b0d-2e29-464d-9058-8377aa9c963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:07.336636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a7b0d-2e29-464d-9058-8377aa9c963c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:07.336917 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a7b0d-2e29-464d-9058-8377aa9c963c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:07.337190 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a7b0d-2e29-464d-9058-8377aa9c963c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:07.338104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a7b0d-2e29-464d-9058-8377aa9c963c None admin] RBAC: Adding query filter params (role.id=790bbad5bfa746499421af10c3bead87, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=642a67f2169944f29179e2a9a4f946b0) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:07.338370 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a7b0d-2e29-464d-9058-8377aa9c963c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:07.339832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a7b0d-2e29-464d-9058-8377aa9c963c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:07.350969 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 498/989] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:26:07 2022] GET /identity/v3/role_assignments?user.id=642a67f2169944f29179e2a9a4f946b0&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=790bbad5bfa746499421af10c3bead87 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:09.020728 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e6bf2-ec0d-48f8-a2de-a2b60c77c99c None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.021249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e6bf2-ec0d-48f8-a2de-a2b60c77c99c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.021249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e6bf2-ec0d-48f8-a2de-a2b60c77c99c None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.023250 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 492/990] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:09.028291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e11fb6-120d-4475-a95f-9e09e6bd4e85 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.028693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e11fb6-120d-4475-a95f-9e09e6bd4e85 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.028853 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e11fb6-120d-4475-a95f-9e09e6bd4e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.046646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c3e11fb6-120d-4475-a95f-9e09e6bd4e85 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:09.047858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c3e11fb6-120d-4475-a95f-9e09e6bd4e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:09.117671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 499/991] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:09.140620 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e6bf2-ec0d-48f8-a2de-a2b60c77c99c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:09.183039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2e323-12ea-483b-a2c9-0e251dee331f None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.183323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2e323-12ea-483b-a2c9-0e251dee331f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.183768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2e323-12ea-483b-a2c9-0e251dee331f None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.185552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 500/992] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:26:09.190735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c932a2-e93b-4064-ba15-a629016bf667 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.191046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c932a2-e93b-4064-ba15-a629016bf667 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.191326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c932a2-e93b-4064-ba15-a629016bf667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.207764 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-05c932a2-e93b-4064-ba15-a629016bf667 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:09.208945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-05c932a2-e93b-4064-ba15-a629016bf667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:09.242729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e6bf2-ec0d-48f8-a2de-a2b60c77c99c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:09.275439 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28bb67-a7f9-4d0c-8413-9a4031bb687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:09.276161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28bb67-a7f9-4d0c-8413-9a4031bb687d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.276440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28bb67-a7f9-4d0c-8413-9a4031bb687d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.276713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28bb67-a7f9-4d0c-8413-9a4031bb687d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.277353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28bb67-a7f9-4d0c-8413-9a4031bb687d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:09.278742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28bb67-a7f9-4d0c-8413-9a4031bb687d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:09.283040 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 501/993] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:09.291223 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-9c28bb67-a7f9-4d0c-8413-9a4031bb687d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 10:26:09.298298 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 493/994] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Feb 28 10:26:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:09.300098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c932a2-e93b-4064-ba15-a629016bf667 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:09.304525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28bb67-a7f9-4d0c-8413-9a4031bb687d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:09.397833 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c932a2-e93b-4064-ba15-a629016bf667 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:09.400946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28bb67-a7f9-4d0c-8413-9a4031bb687d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:09.431785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaef67-b2b5-45bf-aeb7-396d04eaceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:09.432451 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaef67-b2b5-45bf-aeb7-396d04eaceeb None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.432727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaef67-b2b5-45bf-aeb7-396d04eaceeb None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.433003 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaef67-b2b5-45bf-aeb7-396d04eaceeb None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.433335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ef47f-d189-41c5-942c-2cb7ad8dbb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:09.433698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaef67-b2b5-45bf-aeb7-396d04eaceeb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:09.434006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaef67-b2b5-45bf-aeb7-396d04eaceeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:09.434099 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ef47f-d189-41c5-942c-2cb7ad8dbb42 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.434379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ef47f-d189-41c5-942c-2cb7ad8dbb42 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.434649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ef47f-d189-41c5-942c-2cb7ad8dbb42 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.435318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ef47f-d189-41c5-942c-2cb7ad8dbb42 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:09.435410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaef67-b2b5-45bf-aeb7-396d04eaceeb None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:09.437284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ef47f-d189-41c5-942c-2cb7ad8dbb42 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:09.440836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 502/995] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Feb 28 10:26:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:09.446151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaef67-b2b5-45bf-aeb7-396d04eaceeb None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:09.448350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-949ef47f-d189-41c5-942c-2cb7ad8dbb42 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 10:26:09.449540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 494/996] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:26:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:09.455340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ef47f-d189-41c5-942c-2cb7ad8dbb42 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:09.543800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaef67-b2b5-45bf-aeb7-396d04eaceeb None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:09.554009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ef47f-d189-41c5-942c-2cb7ad8dbb42 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:09.578248 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3e513-de80-4f4a-9c49-d11b54980e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:09.578927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3e513-de80-4f4a-9c49-d11b54980e41 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.579217 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3e513-de80-4f4a-9c49-d11b54980e41 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.579497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3e513-de80-4f4a-9c49-d11b54980e41 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.580194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3e513-de80-4f4a-9c49-d11b54980e41 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:09.580503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3e513-de80-4f4a-9c49-d11b54980e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:09.581863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3e513-de80-4f4a-9c49-d11b54980e41 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:09.591589 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 503/997] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Feb 28 10:26:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:09.591805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc8f8a-282c-4de9-8471-a3a44f1691df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:09.591805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc8f8a-282c-4de9-8471-a3a44f1691df None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.591805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc8f8a-282c-4de9-8471-a3a44f1691df None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.591805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc8f8a-282c-4de9-8471-a3a44f1691df None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.592079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc8f8a-282c-4de9-8471-a3a44f1691df None admin] RBAC: Adding query filter params (name=compute) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:09.592079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc8f8a-282c-4de9-8471-a3a44f1691df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:09.592079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc8f8a-282c-4de9-8471-a3a44f1691df None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:09.592270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3e513-de80-4f4a-9c49-d11b54980e41 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:09.596653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 495/998] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:26:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:09.602171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc8f8a-282c-4de9-8471-a3a44f1691df None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:09.687794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3e513-de80-4f4a-9c49-d11b54980e41 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:09.699035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc8f8a-282c-4de9-8471-a3a44f1691df None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:09.719037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e4a4c-d984-48f7-8625-a5087d768e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:09.719683 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4a4c-d984-48f7-8625-a5087d768e1c None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.719963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4a4c-d984-48f7-8625-a5087d768e1c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.720236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4a4c-d984-48f7-8625-a5087d768e1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.720961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e4a4c-d984-48f7-8625-a5087d768e1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:09.722302 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e4a4c-d984-48f7-8625-a5087d768e1c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:09.729805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0656bf9-9837-4fe7-879c-a4e007221995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:09.730457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0656bf9-9837-4fe7-879c-a4e007221995 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.730728 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0656bf9-9837-4fe7-879c-a4e007221995 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.731067 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0656bf9-9837-4fe7-879c-a4e007221995 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.731751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0656bf9-9837-4fe7-879c-a4e007221995 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:09.732048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0656bf9-9837-4fe7-879c-a4e007221995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:09.733937 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0656bf9-9837-4fe7-879c-a4e007221995 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:09.736702 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 504/999] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Feb 28 10:26:09 2022] POST /identity/v3/endpoints => generated 325 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:26:09.737930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aae39-55bb-44fc-9583-872ab52f0364 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.738218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aae39-55bb-44fc-9583-872ab52f0364 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.738493 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aae39-55bb-44fc-9583-872ab52f0364 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.740165 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 505/1000] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:09.745866 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e091c4-37a3-4dcd-918a-6e9f05b607b1 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.746186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e091c4-37a3-4dcd-918a-6e9f05b607b1 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.746423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e091c4-37a3-4dcd-918a-6e9f05b607b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.746646 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 496/1001] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:26:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:09.752568 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0656bf9-9837-4fe7-879c-a4e007221995 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:09.766128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-40e091c4-37a3-4dcd-918a-6e9f05b607b1 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:09.767397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-40e091c4-37a3-4dcd-918a-6e9f05b607b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:09.845023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 506/1002] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:09.857356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0656bf9-9837-4fe7-879c-a4e007221995 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:09.867779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e091c4-37a3-4dcd-918a-6e9f05b607b1 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:09.894387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea54b1d-6375-4993-a0ee-5a503faad14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:09.895114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea54b1d-6375-4993-a0ee-5a503faad14a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:09.895397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea54b1d-6375-4993-a0ee-5a503faad14a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:09.895668 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea54b1d-6375-4993-a0ee-5a503faad14a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:09.896468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea54b1d-6375-4993-a0ee-5a503faad14a None admin] RBAC: Adding query filter params (interface=public, service_id=6f5d27ba1198491181c88146d57b877c, region_id=RegionOne) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:09.896775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea54b1d-6375-4993-a0ee-5a503faad14a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:09.898163 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea54b1d-6375-4993-a0ee-5a503faad14a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:09.908424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 497/1003] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Feb 28 10:26:09 2022] GET /identity/v3/endpoints?service_id=6f5d27ba1198491181c88146d57b877c&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:09.909759 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea54b1d-6375-4993-a0ee-5a503faad14a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:09.975344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e091c4-37a3-4dcd-918a-6e9f05b607b1 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:10.009973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df690-3424-434e-b0fd-d3e9e3bf9472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:10.010606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea54b1d-6375-4993-a0ee-5a503faad14a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:10.011376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df690-3424-434e-b0fd-d3e9e3bf9472 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:10.011864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df690-3424-434e-b0fd-d3e9e3bf9472 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:10.012355 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df690-3424-434e-b0fd-d3e9e3bf9472 None admin] PATH_INFO: `/v3/services/image` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:10.013237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84df690-3424-434e-b0fd-d3e9e3bf9472 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:10.014715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84df690-3424-434e-b0fd-d3e9e3bf9472 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:10.025517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-e84df690-3424-434e-b0fd-d3e9e3bf9472 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 10:26:10.032100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 507/1004] 10.222.0.44 () {56 vars in 1105 bytes} [Mon Feb 28 10:26:09 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:10.032874 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df690-3424-434e-b0fd-d3e9e3bf9472 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:10.049176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cb891-19c9-4489-a44c-fd734dcea3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:10.050371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cb891-19c9-4489-a44c-fd734dcea3ec None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:10.050823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cb891-19c9-4489-a44c-fd734dcea3ec None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:10.051314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cb891-19c9-4489-a44c-fd734dcea3ec None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:10.051786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cb891-19c9-4489-a44c-fd734dcea3ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:10.053137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cb891-19c9-4489-a44c-fd734dcea3ec None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:10.059481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 498/1005] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Feb 28 10:26:09 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:26:10.144472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df690-3424-434e-b0fd-d3e9e3bf9472 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:10.179920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c1961-9e0c-4b97-a7d6-4d7309f27ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:10.180588 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c1961-9e0c-4b97-a7d6-4d7309f27ffc None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:10.180866 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c1961-9e0c-4b97-a7d6-4d7309f27ffc None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:10.181137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c1961-9e0c-4b97-a7d6-4d7309f27ffc None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:10.181841 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c1961-9e0c-4b97-a7d6-4d7309f27ffc None admin] RBAC: Adding query filter params (name=image) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:10.182141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c1961-9e0c-4b97-a7d6-4d7309f27ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:10.183658 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c1961-9e0c-4b97-a7d6-4d7309f27ffc None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:10.194053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 508/1006] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:10.195370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cb891-19c9-4489-a44c-fd734dcea3ec None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:10.296487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cb891-19c9-4489-a44c-fd734dcea3ec None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:10.327827 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45848294-507b-4f1a-ac2b-1879cb2c1b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:10.328490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45848294-507b-4f1a-ac2b-1879cb2c1b33 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:10.328751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45848294-507b-4f1a-ac2b-1879cb2c1b33 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:10.329018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45848294-507b-4f1a-ac2b-1879cb2c1b33 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:10.329699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45848294-507b-4f1a-ac2b-1879cb2c1b33 None admin] RBAC: Adding query filter params (type=image) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:10.329994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45848294-507b-4f1a-ac2b-1879cb2c1b33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:10.331374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45848294-507b-4f1a-ac2b-1879cb2c1b33 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:10.335821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 499/1007] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:12.064952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7227cc4-a347-4501-a90f-37c96c25f1ea None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.065509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7227cc4-a347-4501-a90f-37c96c25f1ea None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.065509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7227cc4-a347-4501-a90f-37c96c25f1ea None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.067438 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 509/1008] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:12.072635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d4efa-b5a6-4d73-8be5-20a2fa0e7c4e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.073058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d4efa-b5a6-4d73-8be5-20a2fa0e7c4e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.073235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d4efa-b5a6-4d73-8be5-20a2fa0e7c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.090648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-f65d4efa-b5a6-4d73-8be5-20a2fa0e7c4e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:12.091901 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f65d4efa-b5a6-4d73-8be5-20a2fa0e7c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:12.157071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 500/1009] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:12.180256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7227cc4-a347-4501-a90f-37c96c25f1ea None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:12.285905 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7227cc4-a347-4501-a90f-37c96c25f1ea None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:12.318452 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46b8ee-3688-4098-9f15-cd9be621c0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:12.319187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46b8ee-3688-4098-9f15-cd9be621c0a1 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.319465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46b8ee-3688-4098-9f15-cd9be621c0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.319732 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46b8ee-3688-4098-9f15-cd9be621c0a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.320910 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46b8ee-3688-4098-9f15-cd9be621c0a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:12.322355 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46b8ee-3688-4098-9f15-cd9be621c0a1 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:12.328724 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 510/1010] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:12.330995 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d4efa-b5a6-4d73-8be5-20a2fa0e7c4e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:12.370966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50c80d-6103-40f1-b69c-9d279d9a5785 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.371255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50c80d-6103-40f1-b69c-9d279d9a5785 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.371722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50c80d-6103-40f1-b69c-9d279d9a5785 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.374068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 511/1011] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:12.379325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2fc92-bea4-450e-bdac-8c85cae3f8c9 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.379830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2fc92-bea4-450e-bdac-8c85cae3f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.379961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2fc92-bea4-450e-bdac-8c85cae3f8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.397369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-27e2fc92-bea4-450e-bdac-8c85cae3f8c9 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:12.398565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-27e2fc92-bea4-450e-bdac-8c85cae3f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:12.427623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d4efa-b5a6-4d73-8be5-20a2fa0e7c4e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:12.461638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e6fa5-ae15-463e-9c0b-44aabe9281d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:12.462304 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e6fa5-ae15-463e-9c0b-44aabe9281d6 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.462582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e6fa5-ae15-463e-9c0b-44aabe9281d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.462851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e6fa5-ae15-463e-9c0b-44aabe9281d6 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.463612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e6fa5-ae15-463e-9c0b-44aabe9281d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:12.465028 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e6fa5-ae15-463e-9c0b-44aabe9281d6 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:12.470434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 512/1012] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:12.498971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 501/1013] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:26:12 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:26:12.499203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2fc92-bea4-450e-bdac-8c85cae3f8c9 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:12.600246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2fc92-bea4-450e-bdac-8c85cae3f8c9 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:12.626789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51118b-1d49-4077-a574-5964e38d2da3 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.627159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51118b-1d49-4077-a574-5964e38d2da3 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.627365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51118b-1d49-4077-a574-5964e38d2da3 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.629377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 502/1014] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:26:12.635443 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e84b2a-2aab-4c57-8d02-997a0cf631ac None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.635823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e84b2a-2aab-4c57-8d02-997a0cf631ac None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.636212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e84b2a-2aab-4c57-8d02-997a0cf631ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.637211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284df96-0744-4904-82ca-500c81659a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:12.638013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284df96-0744-4904-82ca-500c81659a2a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.638290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284df96-0744-4904-82ca-500c81659a2a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.638623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284df96-0744-4904-82ca-500c81659a2a None admin] PATH_INFO: `/v3/services/compute` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.639312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284df96-0744-4904-82ca-500c81659a2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:12.640679 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284df96-0744-4904-82ca-500c81659a2a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:12.652031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-e284df96-0744-4904-82ca-500c81659a2a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 10:26:12.653428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 513/1015] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:26:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:12.654769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-99e84b2a-2aab-4c57-8d02-997a0cf631ac None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:12.656173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-99e84b2a-2aab-4c57-8d02-997a0cf631ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:12.659878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284df96-0744-4904-82ca-500c81659a2a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:12.733470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 503/1016] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:12.757227 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e84b2a-2aab-4c57-8d02-997a0cf631ac None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:12.764260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284df96-0744-4904-82ca-500c81659a2a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:12.799635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c3991-68d5-4818-9ff1-88e847623626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:12.800300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c3991-68d5-4818-9ff1-88e847623626 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.800582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c3991-68d5-4818-9ff1-88e847623626 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.800855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c3991-68d5-4818-9ff1-88e847623626 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.801554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c3991-68d5-4818-9ff1-88e847623626 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:12.801859 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c3991-68d5-4818-9ff1-88e847623626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:12.803252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c3991-68d5-4818-9ff1-88e847623626 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:12.807991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 514/1017] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:26:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:12.814046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c3991-68d5-4818-9ff1-88e847623626 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:12.860446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e84b2a-2aab-4c57-8d02-997a0cf631ac None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:12.892918 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24abd-a4f4-4aea-99b7-4ce0c22d9579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:12.893584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24abd-a4f4-4aea-99b7-4ce0c22d9579 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.893859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24abd-a4f4-4aea-99b7-4ce0c22d9579 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.894128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24abd-a4f4-4aea-99b7-4ce0c22d9579 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.894840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24abd-a4f4-4aea-99b7-4ce0c22d9579 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:12.896219 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24abd-a4f4-4aea-99b7-4ce0c22d9579 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:12.913005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 504/1018] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:26:12 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:26:12.913662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c3991-68d5-4818-9ff1-88e847623626 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:12.957122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44ec7-a4e2-4a25-853c-096c3becf10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:12.957863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44ec7-a4e2-4a25-853c-096c3becf10c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:12.958186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44ec7-a4e2-4a25-853c-096c3becf10c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:12.958461 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44ec7-a4e2-4a25-853c-096c3becf10c None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:12.959196 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b44ec7-a4e2-4a25-853c-096c3becf10c None admin] RBAC: Adding query filter params (type=compute) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:12.959497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b44ec7-a4e2-4a25-853c-096c3becf10c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:12.960905 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b44ec7-a4e2-4a25-853c-096c3becf10c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:12.967124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 515/1019] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Feb 28 10:26:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:12.978930 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24abd-a4f4-4aea-99b7-4ce0c22d9579 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:13.083578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24abd-a4f4-4aea-99b7-4ce0c22d9579 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:13.119444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ee87-e8c3-4990-8c85-eb0aa82fd568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:13.120462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ee87-e8c3-4990-8c85-eb0aa82fd568 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:13.120748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ee87-e8c3-4990-8c85-eb0aa82fd568 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:13.121084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ee87-e8c3-4990-8c85-eb0aa82fd568 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:13.121817 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ee87-e8c3-4990-8c85-eb0aa82fd568 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:13.123687 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ee87-e8c3-4990-8c85-eb0aa82fd568 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:13.147019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 505/1020] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Feb 28 10:26:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:26:14.859028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48a94-784c-4410-b399-449f44043f23 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:14.859567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48a94-784c-4410-b399-449f44043f23 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:14.859567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48a94-784c-4410-b399-449f44043f23 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:14.861660 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 516/1021] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:14.867427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e508-7a85-4545-aafe-40c5ca192c4a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:14.867931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e508-7a85-4545-aafe-40c5ca192c4a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:14.868004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e508-7a85-4545-aafe-40c5ca192c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:14.885974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-6095e508-7a85-4545-aafe-40c5ca192c4a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:14.887207 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6095e508-7a85-4545-aafe-40c5ca192c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:14.958472 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 506/1022] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:14.983892 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48a94-784c-4410-b399-449f44043f23 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:15.084179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48a94-784c-4410-b399-449f44043f23 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:15.118356 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252a818-4e59-4bae-becf-97b32a96fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:15.119160 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252a818-4e59-4bae-becf-97b32a96fd40 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.119485 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252a818-4e59-4bae-becf-97b32a96fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.119762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252a818-4e59-4bae-becf-97b32a96fd40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.120941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252a818-4e59-4bae-becf-97b32a96fd40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:15.122376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252a818-4e59-4bae-becf-97b32a96fd40 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:15.124243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 517/1023] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:15.129661 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095e508-7a85-4545-aafe-40c5ca192c4a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:15.224006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb5ec-40b4-4bc2-84bd-cb3df6a182e1 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.224281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb5ec-40b4-4bc2-84bd-cb3df6a182e1 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.224774 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb5ec-40b4-4bc2-84bd-cb3df6a182e1 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.226716 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 518/1024] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:26:15.227720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095e508-7a85-4545-aafe-40c5ca192c4a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:15.231911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c97f8-d879-4ae9-8484-f70e762a88f7 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.232940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c97f8-d879-4ae9-8484-f70e762a88f7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.233394 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c97f8-d879-4ae9-8484-f70e762a88f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.250516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-959c97f8-d879-4ae9-8484-f70e762a88f7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:15.251991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-959c97f8-d879-4ae9-8484-f70e762a88f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:15.262715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5c8f1-ccd2-4852-9d03-6690e15eb305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:15.263438 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5c8f1-ccd2-4852-9d03-6690e15eb305 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.263753 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5c8f1-ccd2-4852-9d03-6690e15eb305 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.264056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5c8f1-ccd2-4852-9d03-6690e15eb305 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.264731 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5c8f1-ccd2-4852-9d03-6690e15eb305 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:15.266384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5c8f1-ccd2-4852-9d03-6690e15eb305 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:15.294929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 507/1025] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:26:15 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:26:15.323613 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 519/1026] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:15.347408 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5c8f1-ccd2-4852-9d03-6690e15eb305 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:15.451305 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5c8f1-ccd2-4852-9d03-6690e15eb305 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:15.485624 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086070d-2055-4c1f-987b-6f3425f725ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:15.486673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086070d-2055-4c1f-987b-6f3425f725ad None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.486973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086070d-2055-4c1f-987b-6f3425f725ad None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.487238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086070d-2055-4c1f-987b-6f3425f725ad None admin] PATH_INFO: `/v3/services/image` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.487888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086070d-2055-4c1f-987b-6f3425f725ad None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:15.489244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086070d-2055-4c1f-987b-6f3425f725ad None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:15.500472 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-a086070d-2055-4c1f-987b-6f3425f725ad None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 10:26:15.501957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 508/1027] 10.222.0.44 () {56 vars in 1105 bytes} [Mon Feb 28 10:26:15 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:15.508457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c97f8-d879-4ae9-8484-f70e762a88f7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:15.536406 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6f1c-e31a-4073-830b-0c046fb796ce None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.536693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6f1c-e31a-4073-830b-0c046fb796ce None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.536951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6f1c-e31a-4073-830b-0c046fb796ce None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.539021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 509/1028] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:26:15.544105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a98730-cf6b-4186-ac11-c9015ab13434 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.544440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a98730-cf6b-4186-ac11-c9015ab13434 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.545252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a98730-cf6b-4186-ac11-c9015ab13434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.562766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c8a98730-cf6b-4186-ac11-c9015ab13434 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:15.564002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c8a98730-cf6b-4186-ac11-c9015ab13434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:15.610533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c97f8-d879-4ae9-8484-f70e762a88f7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:15.630273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 510/1029] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:15.643846 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd0daa-e8a0-4973-81d3-a4ffb7f3cae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:15.644503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd0daa-e8a0-4973-81d3-a4ffb7f3cae8 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.644794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd0daa-e8a0-4973-81d3-a4ffb7f3cae8 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.645050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd0daa-e8a0-4973-81d3-a4ffb7f3cae8 None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.645741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd0daa-e8a0-4973-81d3-a4ffb7f3cae8 None admin] RBAC: Adding query filter params (name=image) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:15.646039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd0daa-e8a0-4973-81d3-a4ffb7f3cae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:15.647409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd0daa-e8a0-4973-81d3-a4ffb7f3cae8 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:15.652216 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 520/1030] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:15.654862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a98730-cf6b-4186-ac11-c9015ab13434 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:15.658380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd0daa-e8a0-4973-81d3-a4ffb7f3cae8 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:15.749477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a98730-cf6b-4186-ac11-c9015ab13434 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:15.754474 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd0daa-e8a0-4973-81d3-a4ffb7f3cae8 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:15.783941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed97275-5774-48d0-b544-46a42f75b4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:15.785011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97275-5774-48d0-b544-46a42f75b4e3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.785289 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97275-5774-48d0-b544-46a42f75b4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.785560 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97275-5774-48d0-b544-46a42f75b4e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.787827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3d155-a765-4ec1-965a-68d6a19d612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:15.788483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3d155-a765-4ec1-965a-68d6a19d612b None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.788762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3d155-a765-4ec1-965a-68d6a19d612b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.789031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3d155-a765-4ec1-965a-68d6a19d612b None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.789727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3d155-a765-4ec1-965a-68d6a19d612b None admin] RBAC: Adding query filter params (type=image) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:15.790028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3d155-a765-4ec1-965a-68d6a19d612b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:15.791404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3d155-a765-4ec1-965a-68d6a19d612b None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:15.796064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed97275-5774-48d0-b544-46a42f75b4e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:26:15.801468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 521/1031] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:15.802242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3d155-a765-4ec1-965a-68d6a19d612b None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:15.803440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-4ed97275-5774-48d0-b544-46a42f75b4e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:26:15.804840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 511/1032] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Feb 28 10:26:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:15.810294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed97275-5774-48d0-b544-46a42f75b4e3 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:15.899435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3d155-a765-4ec1-965a-68d6a19d612b None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:15.903864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed97275-5774-48d0-b544-46a42f75b4e3 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:15.932697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8881bb6-d9ab-4779-8033-dac9cdfcf052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:15.933342 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8881bb6-d9ab-4779-8033-dac9cdfcf052 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.933619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8881bb6-d9ab-4779-8033-dac9cdfcf052 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.933889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8881bb6-d9ab-4779-8033-dac9cdfcf052 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.934655 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8881bb6-d9ab-4779-8033-dac9cdfcf052 None admin] RBAC: Adding query filter params (interface=public, service_id=50c2550eb02f4e92a87a4acce3decf4a, region_id=RegionOne) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:15.934991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8881bb6-d9ab-4779-8033-dac9cdfcf052 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:15.936360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8881bb6-d9ab-4779-8033-dac9cdfcf052 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:15.936697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49941d3-5603-45e4-93c7-06cbd859415a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:15.937355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49941d3-5603-45e4-93c7-06cbd859415a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:15.937639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49941d3-5603-45e4-93c7-06cbd859415a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:15.937913 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49941d3-5603-45e4-93c7-06cbd859415a None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:15.938708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49941d3-5603-45e4-93c7-06cbd859415a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:15.938973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49941d3-5603-45e4-93c7-06cbd859415a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:15.940320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49941d3-5603-45e4-93c7-06cbd859415a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:15.945664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 522/1033] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Feb 28 10:26:15 2022] GET /identity/v3/endpoints?service_id=50c2550eb02f4e92a87a4acce3decf4a&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:15.946500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8881bb6-d9ab-4779-8033-dac9cdfcf052 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:15.948726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 512/1034] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Feb 28 10:26:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:15.953768 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49941d3-5603-45e4-93c7-06cbd859415a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:16.043393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8881bb6-d9ab-4779-8033-dac9cdfcf052 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:16.055695 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49941d3-5603-45e4-93c7-06cbd859415a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:16.081098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee369dab-0236-4dc5-9936-ccf51db2ca0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:16.081098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee369dab-0236-4dc5-9936-ccf51db2ca0a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:16.081098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee369dab-0236-4dc5-9936-ccf51db2ca0a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:16.081098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee369dab-0236-4dc5-9936-ccf51db2ca0a None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:16.084288 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee369dab-0236-4dc5-9936-ccf51db2ca0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:16.084288 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee369dab-0236-4dc5-9936-ccf51db2ca0a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:16.090960 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 523/1035] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Feb 28 10:26:15 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:26:16.091434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd08e92-5bd4-4b65-bfb6-9a45d95e953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:16.092960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd08e92-5bd4-4b65-bfb6-9a45d95e953c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:16.093243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd08e92-5bd4-4b65-bfb6-9a45d95e953c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:16.093516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd08e92-5bd4-4b65-bfb6-9a45d95e953c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:16.105174 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd08e92-5bd4-4b65-bfb6-9a45d95e953c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:16.106663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd08e92-5bd4-4b65-bfb6-9a45d95e953c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:16.124973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-4dd08e92-5bd4-4b65-bfb6-9a45d95e953c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:26:16.126428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 513/1036] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:16.132170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee369dab-0236-4dc5-9936-ccf51db2ca0a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:16.237677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee369dab-0236-4dc5-9936-ccf51db2ca0a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:16.272817 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f3a8-738a-43b6-807b-0a24aa170905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:16.273477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f3a8-738a-43b6-807b-0a24aa170905 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:16.273753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f3a8-738a-43b6-807b-0a24aa170905 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:16.274027 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f3a8-738a-43b6-807b-0a24aa170905 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:16.274746 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f3a8-738a-43b6-807b-0a24aa170905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:16.275083 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f3a8-738a-43b6-807b-0a24aa170905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:16.276443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f3a8-738a-43b6-807b-0a24aa170905 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:16.288247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 524/1037] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:16.293933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd08e92-5bd4-4b65-bfb6-9a45d95e953c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:16.392407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd08e92-5bd4-4b65-bfb6-9a45d95e953c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:16.424574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e698ab4-661c-4732-9ca7-cfbc1003683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:16.425359 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e698ab4-661c-4732-9ca7-cfbc1003683c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:16.425634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e698ab4-661c-4732-9ca7-cfbc1003683c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:16.425901 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e698ab4-661c-4732-9ca7-cfbc1003683c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:16.433363 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e698ab4-661c-4732-9ca7-cfbc1003683c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:16.434817 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e698ab4-661c-4732-9ca7-cfbc1003683c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:16.448210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-5e698ab4-661c-4732-9ca7-cfbc1003683c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:26:16.453873 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 514/1038] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Feb 28 10:26:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:16.455132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f3a8-738a-43b6-807b-0a24aa170905 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:16.553336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f3a8-738a-43b6-807b-0a24aa170905 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:16.586130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27a44-69d2-4020-a553-63a577919a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:16.586790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27a44-69d2-4020-a553-63a577919a7f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:16.587114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27a44-69d2-4020-a553-63a577919a7f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:16.587398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27a44-69d2-4020-a553-63a577919a7f None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:16.588206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27a44-69d2-4020-a553-63a577919a7f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:16.588511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27a44-69d2-4020-a553-63a577919a7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:16.589921 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27a44-69d2-4020-a553-63a577919a7f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:16.606453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 525/1039] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Feb 28 10:26:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:16.611851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e698ab4-661c-4732-9ca7-cfbc1003683c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:16.706373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e698ab4-661c-4732-9ca7-cfbc1003683c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:16.736847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6b41a-91d5-4328-8e3d-31c346a85d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:16.737484 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6b41a-91d5-4328-8e3d-31c346a85d7c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:16.737765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6b41a-91d5-4328-8e3d-31c346a85d7c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:16.738032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6b41a-91d5-4328-8e3d-31c346a85d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:16.800926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6b41a-91d5-4328-8e3d-31c346a85d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:16.802366 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6b41a-91d5-4328-8e3d-31c346a85d7c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:16.895663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 515/1040] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:26:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:26:16.901023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27a44-69d2-4020-a553-63a577919a7f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:16.995552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27a44-69d2-4020-a553-63a577919a7f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:17.027922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b919a4-fb21-42e6-bb70-bba1dd1d6826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:17.028688 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b919a4-fb21-42e6-bb70-bba1dd1d6826 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:17.028989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b919a4-fb21-42e6-bb70-bba1dd1d6826 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:17.029256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b919a4-fb21-42e6-bb70-bba1dd1d6826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:17.038623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b919a4-fb21-42e6-bb70-bba1dd1d6826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:17.040060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b919a4-fb21-42e6-bb70-bba1dd1d6826 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:17.056398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-84b919a4-fb21-42e6-bb70-bba1dd1d6826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:26:17.057729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 526/1041] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:17.063719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6b41a-91d5-4328-8e3d-31c346a85d7c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:17.162580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6b41a-91d5-4328-8e3d-31c346a85d7c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:17.193823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886e94-8b2e-4677-bccb-09918081c432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:17.194473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886e94-8b2e-4677-bccb-09918081c432 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:17.194747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886e94-8b2e-4677-bccb-09918081c432 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:17.195041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886e94-8b2e-4677-bccb-09918081c432 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:17.195743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1886e94-8b2e-4677-bccb-09918081c432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:17.196044 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1886e94-8b2e-4677-bccb-09918081c432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:17.197392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1886e94-8b2e-4677-bccb-09918081c432 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:17.212975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 516/1042] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:17.214306 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b919a4-fb21-42e6-bb70-bba1dd1d6826 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:17.311174 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b919a4-fb21-42e6-bb70-bba1dd1d6826 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:17.345721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9045b6-e1cf-4434-a761-7be524a6a838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:17.346499 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9045b6-e1cf-4434-a761-7be524a6a838 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:17.346775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9045b6-e1cf-4434-a761-7be524a6a838 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:17.347074 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9045b6-e1cf-4434-a761-7be524a6a838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:17.353537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9045b6-e1cf-4434-a761-7be524a6a838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:17.354966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9045b6-e1cf-4434-a761-7be524a6a838 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:17.367500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-0f9045b6-e1cf-4434-a761-7be524a6a838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:26:17.368810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 527/1043] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:17.374775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886e94-8b2e-4677-bccb-09918081c432 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:17.467435 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886e94-8b2e-4677-bccb-09918081c432 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:17.498402 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5df5d-fe90-4244-a3b4-e4df47d5ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:17.499071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5df5d-fe90-4244-a3b4-e4df47d5ba5e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:17.499346 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5df5d-fe90-4244-a3b4-e4df47d5ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:17.499613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5df5d-fe90-4244-a3b4-e4df47d5ba5e None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:17.500371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5df5d-fe90-4244-a3b4-e4df47d5ba5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:17.500670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5df5d-fe90-4244-a3b4-e4df47d5ba5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:17.502084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5df5d-fe90-4244-a3b4-e4df47d5ba5e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:17.514796 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 517/1044] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:17.520501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9045b6-e1cf-4434-a761-7be524a6a838 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:17.614920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9045b6-e1cf-4434-a761-7be524a6a838 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:17.648049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f318c-2fbc-4b1c-9e74-c02220848e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:17.649075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f318c-2fbc-4b1c-9e74-c02220848e5e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:17.649559 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f318c-2fbc-4b1c-9e74-c02220848e5e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:17.650046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f318c-2fbc-4b1c-9e74-c02220848e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:17.651094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f318c-2fbc-4b1c-9e74-c02220848e5e None admin] RBAC: Adding query filter params (role.id=790bbad5bfa746499421af10c3bead87, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=b4132c15e66a4a619574f7aba10d6d71) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:17.651607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f318c-2fbc-4b1c-9e74-c02220848e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:17.653220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f318c-2fbc-4b1c-9e74-c02220848e5e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:17.660007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 528/1045] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:26:17 2022] GET /identity/v3/role_assignments?user.id=b4132c15e66a4a619574f7aba10d6d71&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=790bbad5bfa746499421af10c3bead87 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:17.668851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f387f5-6221-45b4-9e31-63226eb41d9c None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:17.669193 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f387f5-6221-45b4-9e31-63226eb41d9c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:17.669423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f387f5-6221-45b4-9e31-63226eb41d9c None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:17.671518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 518/1046] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:17.677671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ceb5-2a34-4470-990a-780e67dc3655 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:17.678005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ceb5-2a34-4470-990a-780e67dc3655 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:17.678234 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ceb5-2a34-4470-990a-780e67dc3655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:17.696237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-7914ceb5-2a34-4470-990a-780e67dc3655 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:17.697440 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7914ceb5-2a34-4470-990a-780e67dc3655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:17.769622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 529/1047] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:17.792637 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f387f5-6221-45b4-9e31-63226eb41d9c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:17.893201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f387f5-6221-45b4-9e31-63226eb41d9c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:17.926076 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c7d7-81f0-456b-a1a2-6049d00538ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:17.926890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c7d7-81f0-456b-a1a2-6049d00538ac None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:17.927191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c7d7-81f0-456b-a1a2-6049d00538ac None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:17.927462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c7d7-81f0-456b-a1a2-6049d00538ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:17.937342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c7d7-81f0-456b-a1a2-6049d00538ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:26:17.944155 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-8468c7d7-81f0-456b-a1a2-6049d00538ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:26:17.945345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 519/1048] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:17.952095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ceb5-2a34-4470-990a-780e67dc3655 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:18.049462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ceb5-2a34-4470-990a-780e67dc3655 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:18.086946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de6367-a139-4c5e-9ccf-b50ca4c78f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:18.086946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6367-a139-4c5e-9ccf-b50ca4c78f0c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.086946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6367-a139-4c5e-9ccf-b50ca4c78f0c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.086946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6367-a139-4c5e-9ccf-b50ca4c78f0c None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.087537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de6367-a139-4c5e-9ccf-b50ca4c78f0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:18.090943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de6367-a139-4c5e-9ccf-b50ca4c78f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:18.090943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de6367-a139-4c5e-9ccf-b50ca4c78f0c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:18.102333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 530/1049] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:18.103593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c7d7-81f0-456b-a1a2-6049d00538ac None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:18.198366 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c7d7-81f0-456b-a1a2-6049d00538ac None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:18.230433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b84d9-fe11-4f56-a8fd-3581c99ca648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:18.231569 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b84d9-fe11-4f56-a8fd-3581c99ca648 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.232615 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b84d9-fe11-4f56-a8fd-3581c99ca648 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.233070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b84d9-fe11-4f56-a8fd-3581c99ca648 None admin] PATH_INFO: `/v3/users/68da65f8ce4c4911b38d8fc21d0fcae3` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.246108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b84d9-fe11-4f56-a8fd-3581c99ca648 None admin] RBAC: Authorizing `identity:get_user(user_id=68da65f8ce4c4911b38d8fc21d0fcae3)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:18.247830 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b84d9-fe11-4f56-a8fd-3581c99ca648 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:18.249672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 520/1050] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:18 2022] GET /identity/v3/users/68da65f8ce4c4911b38d8fc21d0fcae3 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:18.255819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de6367-a139-4c5e-9ccf-b50ca4c78f0c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:18.350572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de6367-a139-4c5e-9ccf-b50ca4c78f0c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:18.382773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449157af-9ab2-4c9c-8e91-89f929f38b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:18.383436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449157af-9ab2-4c9c-8e91-89f929f38b91 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.383711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449157af-9ab2-4c9c-8e91-89f929f38b91 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.383978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449157af-9ab2-4c9c-8e91-89f929f38b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.407144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe2aa2-3a99-44df-84ee-d393c460e268 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.407477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe2aa2-3a99-44df-84ee-d393c460e268 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.407697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe2aa2-3a99-44df-84ee-d393c460e268 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.409590 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 521/1051] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:26:18.414445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f21b-f28a-4645-9e31-473a2b14202a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.414725 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f21b-f28a-4645-9e31-473a2b14202a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.415030 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f21b-f28a-4645-9e31-473a2b14202a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.431954 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e757f21b-f28a-4645-9e31-473a2b14202a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:18.433128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e757f21b-f28a-4645-9e31-473a2b14202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:18.449625 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449157af-9ab2-4c9c-8e91-89f929f38b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:18.451114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449157af-9ab2-4c9c-8e91-89f929f38b91 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:18.500214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 522/1052] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:18.523756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757f21b-f28a-4645-9e31-473a2b14202a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:18.552185 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 531/1053] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:26:18 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 10:26:18.557920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449157af-9ab2-4c9c-8e91-89f929f38b91 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:18.618131 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757f21b-f28a-4645-9e31-473a2b14202a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:18.651581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cc3fb-ca81-45cd-8512-99c0818bbb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:18.652362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cc3fb-ca81-45cd-8512-99c0818bbb4e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.652642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cc3fb-ca81-45cd-8512-99c0818bbb4e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.652917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cc3fb-ca81-45cd-8512-99c0818bbb4e None admin] PATH_INFO: `/v3/services/image` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.653563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cc3fb-ca81-45cd-8512-99c0818bbb4e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:18.654940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449157af-9ab2-4c9c-8e91-89f929f38b91 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:18.655544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cc3fb-ca81-45cd-8512-99c0818bbb4e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:18.665960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-016cc3fb-ca81-45cd-8512-99c0818bbb4e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 10:26:18.667309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 523/1054] 10.222.0.44 () {56 vars in 1105 bytes} [Mon Feb 28 10:26:18 2022] GET /identity/v3/services/image => generated 86 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:18.673655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cc3fb-ca81-45cd-8512-99c0818bbb4e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:18.693819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c88dd1-8458-4b0a-a7a6-d96e7fe0915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:18.694671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c88dd1-8458-4b0a-a7a6-d96e7fe0915f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.694970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c88dd1-8458-4b0a-a7a6-d96e7fe0915f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.695241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c88dd1-8458-4b0a-a7a6-d96e7fe0915f None admin] PATH_INFO: `/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.696423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c88dd1-8458-4b0a-a7a6-d96e7fe0915f None admin] RBAC: Authorizing `identity:get_project(project_id=dfd1ccad8e7b4f88851dde03ab864f65)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:18.697827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c88dd1-8458-4b0a-a7a6-d96e7fe0915f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:18.704554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 532/1055] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:26:18 2022] GET /identity/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:18.705938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c88dd1-8458-4b0a-a7a6-d96e7fe0915f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:18.772723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cc3fb-ca81-45cd-8512-99c0818bbb4e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:18.804596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c88dd1-8458-4b0a-a7a6-d96e7fe0915f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:18.806999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c79447-6c7e-46d0-a897-7d05215d46eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:18.807662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c79447-6c7e-46d0-a897-7d05215d46eb None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.807938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c79447-6c7e-46d0-a897-7d05215d46eb None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.808208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c79447-6c7e-46d0-a897-7d05215d46eb None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.808898 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c79447-6c7e-46d0-a897-7d05215d46eb None admin] RBAC: Adding query filter params (name=image) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:18.809198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c79447-6c7e-46d0-a897-7d05215d46eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:18.810615 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c79447-6c7e-46d0-a897-7d05215d46eb None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:18.819912 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 524/1056] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:18.821177 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c79447-6c7e-46d0-a897-7d05215d46eb None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:18.837949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262641ee-3fe2-415c-bad3-d63a80a4a27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:18.838592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262641ee-3fe2-415c-bad3-d63a80a4a27c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.838882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262641ee-3fe2-415c-bad3-d63a80a4a27c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.839184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262641ee-3fe2-415c-bad3-d63a80a4a27c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.840004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262641ee-3fe2-415c-bad3-d63a80a4a27c None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=dfd1ccad8e7b4f88851dde03ab864f65, user.id=68da65f8ce4c4911b38d8fc21d0fcae3) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:18.840312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262641ee-3fe2-415c-bad3-d63a80a4a27c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:18.842258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262641ee-3fe2-415c-bad3-d63a80a4a27c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:18.854936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 533/1057] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:26:18 2022] GET /identity/v3/role_assignments?user.id=68da65f8ce4c4911b38d8fc21d0fcae3&scope.project.id=dfd1ccad8e7b4f88851dde03ab864f65&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:18.931863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c79447-6c7e-46d0-a897-7d05215d46eb None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:18.965792 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03c23a-fb2b-4528-b583-752d9c4855e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:18.967147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03c23a-fb2b-4528-b583-752d9c4855e4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.967434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03c23a-fb2b-4528-b583-752d9c4855e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.967730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03c23a-fb2b-4528-b583-752d9c4855e4 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.968432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03c23a-fb2b-4528-b583-752d9c4855e4 None admin] RBAC: Adding query filter params (type=image) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:18.968731 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03c23a-fb2b-4528-b583-752d9c4855e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:18.970105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03c23a-fb2b-4528-b583-752d9c4855e4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:18.975462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 525/1058] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:18.981372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262641ee-3fe2-415c-bad3-d63a80a4a27c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:19.079905 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262641ee-3fe2-415c-bad3-d63a80a4a27c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:19.113741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c5bec-ea54-400a-8a10-c50e8e2b92ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:19.114391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5bec-ea54-400a-8a10-c50e8e2b92ee None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:19.114668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5bec-ea54-400a-8a10-c50e8e2b92ee None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:19.115071 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5bec-ea54-400a-8a10-c50e8e2b92ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:19.115812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c5bec-ea54-400a-8a10-c50e8e2b92ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:19.117155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c5bec-ea54-400a-8a10-c50e8e2b92ee None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:19.143156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 534/1059] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Feb 28 10:26:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:26:19.971383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411020-5c76-4360-84c6-e5f9c1d37428 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:19.971904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411020-5c76-4360-84c6-e5f9c1d37428 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:19.971981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411020-5c76-4360-84c6-e5f9c1d37428 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:19.973860 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 526/1060] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:19.978925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309e5f-ae34-4409-b98f-b713e131a060 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:19.979243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309e5f-ae34-4409-b98f-b713e131a060 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:19.979522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309e5f-ae34-4409-b98f-b713e131a060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:19.996068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c0309e5f-ae34-4409-b98f-b713e131a060 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:19.997247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c0309e5f-ae34-4409-b98f-b713e131a060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:20.066110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 535/1061] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:20.089433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8411020-5c76-4360-84c6-e5f9c1d37428 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:20.185178 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8411020-5c76-4360-84c6-e5f9c1d37428 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:20.217040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2bcbd-5f4c-4634-bf08-5c0025f854d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:20.217835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2bcbd-5f4c-4634-bf08-5c0025f854d1 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:20.218105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2bcbd-5f4c-4634-bf08-5c0025f854d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:20.218364 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2bcbd-5f4c-4634-bf08-5c0025f854d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:20.228426 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2bcbd-5f4c-4634-bf08-5c0025f854d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:26:20.242421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-82a2bcbd-5f4c-4634-bf08-5c0025f854d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:26:20.242421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 527/1062] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Feb 28 10:26:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:20.243393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0309e5f-ae34-4409-b98f-b713e131a060 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:20.339340 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0309e5f-ae34-4409-b98f-b713e131a060 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:20.372488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f5208-3973-4b97-ac13-0c1f74679980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:20.373687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f5208-3973-4b97-ac13-0c1f74679980 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:20.373964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f5208-3973-4b97-ac13-0c1f74679980 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:20.374231 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f5208-3973-4b97-ac13-0c1f74679980 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:20.374984 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f5208-3973-4b97-ac13-0c1f74679980 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:20.375285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f5208-3973-4b97-ac13-0c1f74679980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:20.376665 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f5208-3973-4b97-ac13-0c1f74679980 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:20.384810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 536/1063] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Feb 28 10:26:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:20.390774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2bcbd-5f4c-4634-bf08-5c0025f854d1 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:20.484316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2bcbd-5f4c-4634-bf08-5c0025f854d1 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:20.516850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09953933-fdc3-45ee-b9ab-fce6b9101c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:20.517628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09953933-fdc3-45ee-b9ab-fce6b9101c93 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:20.517901 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09953933-fdc3-45ee-b9ab-fce6b9101c93 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:20.518163 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09953933-fdc3-45ee-b9ab-fce6b9101c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:20.527686 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09953933-fdc3-45ee-b9ab-fce6b9101c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:20.529141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09953933-fdc3-45ee-b9ab-fce6b9101c93 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:20.544912 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-09953933-fdc3-45ee-b9ab-fce6b9101c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:26:20.546235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 528/1064] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:20.551673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f5208-3973-4b97-ac13-0c1f74679980 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:20.645621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f5208-3973-4b97-ac13-0c1f74679980 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:20.677058 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645650f-177b-468e-8690-641e72e56c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:20.677704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645650f-177b-468e-8690-641e72e56c38 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:20.678102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645650f-177b-468e-8690-641e72e56c38 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:20.678369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645650f-177b-468e-8690-641e72e56c38 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:20.679110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645650f-177b-468e-8690-641e72e56c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:20.679412 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645650f-177b-468e-8690-641e72e56c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:20.680772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645650f-177b-468e-8690-641e72e56c38 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:20.693489 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 537/1065] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:20.699365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09953933-fdc3-45ee-b9ab-fce6b9101c93 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:20.799672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09953933-fdc3-45ee-b9ab-fce6b9101c93 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:20.835767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb02082-1e6c-4732-aa56-8ac4b5032378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:20.836556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb02082-1e6c-4732-aa56-8ac4b5032378 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:20.836833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb02082-1e6c-4732-aa56-8ac4b5032378 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:20.837100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb02082-1e6c-4732-aa56-8ac4b5032378 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:20.845418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb02082-1e6c-4732-aa56-8ac4b5032378 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:20.846881 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb02082-1e6c-4732-aa56-8ac4b5032378 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:20.860183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-0cb02082-1e6c-4732-aa56-8ac4b5032378 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:26:20.861532 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 529/1066] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Feb 28 10:26:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:20.867077 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645650f-177b-468e-8690-641e72e56c38 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:20.962991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645650f-177b-468e-8690-641e72e56c38 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:20.998537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243176f-d2e0-47d9-b416-f7ccb92f1b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:20.999317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243176f-d2e0-47d9-b416-f7ccb92f1b13 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:20.999575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243176f-d2e0-47d9-b416-f7ccb92f1b13 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:20.999773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243176f-d2e0-47d9-b416-f7ccb92f1b13 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.000599 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243176f-d2e0-47d9-b416-f7ccb92f1b13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:21.000907 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243176f-d2e0-47d9-b416-f7ccb92f1b13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:21.002339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243176f-d2e0-47d9-b416-f7ccb92f1b13 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:21.024267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 538/1067] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Feb 28 10:26:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:21.025696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb02082-1e6c-4732-aa56-8ac4b5032378 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:21.127602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb02082-1e6c-4732-aa56-8ac4b5032378 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:21.135784 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd91ab-84a7-423c-9fcd-266bc9d663f9 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.136119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd91ab-84a7-423c-9fcd-266bc9d663f9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.136344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd91ab-84a7-423c-9fcd-266bc9d663f9 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.138286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 539/1068] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:26:21.143685 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a484-83f3-4ea1-9b78-970cb360728a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.143971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a484-83f3-4ea1-9b78-970cb360728a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.144246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a484-83f3-4ea1-9b78-970cb360728a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.160407 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6539a484-83f3-4ea1-9b78-970cb360728a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:21.161592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6539a484-83f3-4ea1-9b78-970cb360728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:21.161909 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d4bc9-ed04-4584-9523-257f1cc7e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:21.162694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4bc9-ed04-4584-9523-257f1cc7e6fe None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.162999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4bc9-ed04-4584-9523-257f1cc7e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.163272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4bc9-ed04-4584-9523-257f1cc7e6fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.173739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d4bc9-ed04-4584-9523-257f1cc7e6fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:21.175175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d4bc9-ed04-4584-9523-257f1cc7e6fe None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:21.191563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-ed9d4bc9-ed04-4584-9523-257f1cc7e6fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:26:21.193136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 530/1069] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:21.198281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d4bc9-ed04-4584-9523-257f1cc7e6fe None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:21.234942 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 540/1070] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:21.258072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a484-83f3-4ea1-9b78-970cb360728a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:21.295431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d4bc9-ed04-4584-9523-257f1cc7e6fe None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:21.331254 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c857-5893-4d6d-8792-6197553b19cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:21.331962 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c857-5893-4d6d-8792-6197553b19cf None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.332244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c857-5893-4d6d-8792-6197553b19cf None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.332516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c857-5893-4d6d-8792-6197553b19cf None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.333249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97c857-5893-4d6d-8792-6197553b19cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:21.333554 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97c857-5893-4d6d-8792-6197553b19cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:21.334989 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97c857-5893-4d6d-8792-6197553b19cf None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:21.348247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 531/1071] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:21.353905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c857-5893-4d6d-8792-6197553b19cf None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:21.455780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c857-5893-4d6d-8792-6197553b19cf None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:21.478583 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a484-83f3-4ea1-9b78-970cb360728a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:21.488637 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef87cf0-9a6b-4abc-967d-f385750484b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:21.489431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef87cf0-9a6b-4abc-967d-f385750484b7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.489709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef87cf0-9a6b-4abc-967d-f385750484b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.489979 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef87cf0-9a6b-4abc-967d-f385750484b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.496935 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef87cf0-9a6b-4abc-967d-f385750484b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:21.498959 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef87cf0-9a6b-4abc-967d-f385750484b7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:21.511996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-eef87cf0-9a6b-4abc-967d-f385750484b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:26:21.512825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aa5fa-26d5-414d-afd0-b61e41fcb2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:21.513201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 532/1072] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:21.513640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aa5fa-26d5-414d-afd0-b61e41fcb2ac None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.513918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aa5fa-26d5-414d-afd0-b61e41fcb2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.514188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aa5fa-26d5-414d-afd0-b61e41fcb2ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.514399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e97114-541e-412f-b3d1-94c824b50d47 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.514680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e97114-541e-412f-b3d1-94c824b50d47 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.514962 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e97114-541e-412f-b3d1-94c824b50d47 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.516598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 533/1073] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:21.519728 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e97114-541e-412f-b3d1-94c824b50d47 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:21.524448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62aa5fa-26d5-414d-afd0-b61e41fcb2ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:26:21.531261 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-c62aa5fa-26d5-414d-afd0-b61e41fcb2ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:26:21.532551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 541/1074] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:26:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:21.534886 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b8649-2a7d-4a58-8866-71f8dad4e76a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.535273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b8649-2a7d-4a58-8866-71f8dad4e76a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.535554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b8649-2a7d-4a58-8866-71f8dad4e76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.551753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e81b8649-2a7d-4a58-8866-71f8dad4e76a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:21.552915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e81b8649-2a7d-4a58-8866-71f8dad4e76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:21.614330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 542/1075] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:21.615096 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b8649-2a7d-4a58-8866-71f8dad4e76a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:21.615385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e97114-541e-412f-b3d1-94c824b50d47 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:21.648428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26b525-2438-47e1-9656-d87c2e127197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:21.649075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26b525-2438-47e1-9656-d87c2e127197 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.649350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26b525-2438-47e1-9656-d87c2e127197 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.649619 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26b525-2438-47e1-9656-d87c2e127197 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.650382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26b525-2438-47e1-9656-d87c2e127197 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:21.650684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26b525-2438-47e1-9656-d87c2e127197 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:21.652141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26b525-2438-47e1-9656-d87c2e127197 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:21.663925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 534/1076] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:21.664781 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26b525-2438-47e1-9656-d87c2e127197 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:21.714049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b8649-2a7d-4a58-8866-71f8dad4e76a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:21.745885 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a289f61-4282-46e3-92ea-09962f84906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:21.746531 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a289f61-4282-46e3-92ea-09962f84906a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.746808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a289f61-4282-46e3-92ea-09962f84906a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.747104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a289f61-4282-46e3-92ea-09962f84906a None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.748362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a289f61-4282-46e3-92ea-09962f84906a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:21.748661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a289f61-4282-46e3-92ea-09962f84906a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:21.749998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a289f61-4282-46e3-92ea-09962f84906a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:21.757431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26b525-2438-47e1-9656-d87c2e127197 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:21.757621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 543/1077] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:26:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:21.758312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a289f61-4282-46e3-92ea-09962f84906a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:21.789986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efae61-59a2-4013-8191-66d7fca6058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:21.790618 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efae61-59a2-4013-8191-66d7fca6058e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.790889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efae61-59a2-4013-8191-66d7fca6058e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.791187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efae61-59a2-4013-8191-66d7fca6058e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.851233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a289f61-4282-46e3-92ea-09962f84906a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:21.853596 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efae61-59a2-4013-8191-66d7fca6058e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:21.855054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efae61-59a2-4013-8191-66d7fca6058e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:21.883310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169b302-8ce7-4fd3-8a04-beb68cba033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:21.884109 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169b302-8ce7-4fd3-8a04-beb68cba033a None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.884386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169b302-8ce7-4fd3-8a04-beb68cba033a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.884918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169b302-8ce7-4fd3-8a04-beb68cba033a None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/b4132c15e66a4a619574f7aba10d6d71/roles/790bbad5bfa746499421af10c3bead87` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.887154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169b302-8ce7-4fd3-8a04-beb68cba033a None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=b4132c15e66a4a619574f7aba10d6d71, role_id=790bbad5bfa746499421af10c3bead87)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:21.889161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169b302-8ce7-4fd3-8a04-beb68cba033a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:21.901937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 544/1078] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:26:21 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/b4132c15e66a4a619574f7aba10d6d71/roles/790bbad5bfa746499421af10c3bead87 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:26:21.902709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169b302-8ce7-4fd3-8a04-beb68cba033a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:21.952878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 535/1079] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:26:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:26:21.958941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efae61-59a2-4013-8191-66d7fca6058e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:22.013210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169b302-8ce7-4fd3-8a04-beb68cba033a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:22.048161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e382717-b787-4c84-88b1-5df79eb2b27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:22.049035 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e382717-b787-4c84-88b1-5df79eb2b27e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:22.049308 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e382717-b787-4c84-88b1-5df79eb2b27e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:22.049602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e382717-b787-4c84-88b1-5df79eb2b27e None admin] PATH_INFO: `/v3/users/68da65f8ce4c4911b38d8fc21d0fcae3` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:22.050939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e382717-b787-4c84-88b1-5df79eb2b27e None admin] RBAC: Authorizing `identity:get_user(user_id=68da65f8ce4c4911b38d8fc21d0fcae3)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:22.052377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e382717-b787-4c84-88b1-5df79eb2b27e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:22.054231 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 545/1080] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:21 2022] GET /identity/v3/users/68da65f8ce4c4911b38d8fc21d0fcae3 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:22.060628 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e382717-b787-4c84-88b1-5df79eb2b27e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:22.063384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efae61-59a2-4013-8191-66d7fca6058e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:22.100630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50e468-c2d4-4120-b7da-9e0588cc75a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:22.101420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50e468-c2d4-4120-b7da-9e0588cc75a5 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:22.101745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50e468-c2d4-4120-b7da-9e0588cc75a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:22.102015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50e468-c2d4-4120-b7da-9e0588cc75a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:22.112683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50e468-c2d4-4120-b7da-9e0588cc75a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:22.114123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50e468-c2d4-4120-b7da-9e0588cc75a5 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:22.130583 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-3c50e468-c2d4-4120-b7da-9e0588cc75a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:26:22.132133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 536/1081] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:22.138800 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50e468-c2d4-4120-b7da-9e0588cc75a5 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:22.159501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e382717-b787-4c84-88b1-5df79eb2b27e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:22.195900 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4808-2c48-42b6-9674-670750875a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:22.196891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4808-2c48-42b6-9674-670750875a20 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:22.197166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4808-2c48-42b6-9674-670750875a20 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:22.197734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4808-2c48-42b6-9674-670750875a20 None admin] PATH_INFO: `/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:22.199185 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4808-2c48-42b6-9674-670750875a20 None admin] RBAC: Authorizing `identity:get_project(project_id=dfd1ccad8e7b4f88851dde03ab864f65)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:22.200787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4808-2c48-42b6-9674-670750875a20 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:22.202635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 546/1082] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:26:22 2022] GET /identity/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:22.208106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4808-2c48-42b6-9674-670750875a20 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:22.234002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50e468-c2d4-4120-b7da-9e0588cc75a5 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:22.269199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b66ca-83c2-46ec-91fd-ac981f99cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:22.269888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b66ca-83c2-46ec-91fd-ac981f99cae3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:22.270168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b66ca-83c2-46ec-91fd-ac981f99cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:22.270435 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b66ca-83c2-46ec-91fd-ac981f99cae3 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:22.271171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b66ca-83c2-46ec-91fd-ac981f99cae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:22.271473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b66ca-83c2-46ec-91fd-ac981f99cae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:22.272841 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b66ca-83c2-46ec-91fd-ac981f99cae3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:22.284061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 537/1083] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:22.316668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4808-2c48-42b6-9674-670750875a20 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:22.351242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56b90c-2393-4754-af0c-dc8f8bddd135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:22.352133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56b90c-2393-4754-af0c-dc8f8bddd135 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:22.352409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56b90c-2393-4754-af0c-dc8f8bddd135 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:22.352685 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56b90c-2393-4754-af0c-dc8f8bddd135 None admin] PATH_INFO: `/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65/users/68da65f8ce4c4911b38d8fc21d0fcae3/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:22.354653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56b90c-2393-4754-af0c-dc8f8bddd135 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfd1ccad8e7b4f88851dde03ab864f65, user_id=68da65f8ce4c4911b38d8fc21d0fcae3, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:22.356115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56b90c-2393-4754-af0c-dc8f8bddd135 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:22.370964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 547/1084] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:26:22 2022] PUT /identity/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65/users/68da65f8ce4c4911b38d8fc21d0fcae3/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:26:24.201723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc810b-5840-44a8-8869-a18e725299c5 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:24.202238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc810b-5840-44a8-8869-a18e725299c5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:24.202326 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc810b-5840-44a8-8869-a18e725299c5 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:24.204083 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 538/1085] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:24.209258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc0006-705b-4495-b36f-551522c6d63d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:24.209656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc0006-705b-4495-b36f-551522c6d63d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:24.209812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc0006-705b-4495-b36f-551522c6d63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:24.226806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-7cdc0006-705b-4495-b36f-551522c6d63d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:24.228046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7cdc0006-705b-4495-b36f-551522c6d63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:24.293890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 548/1086] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:24.320204 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc810b-5840-44a8-8869-a18e725299c5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:24.418730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc810b-5840-44a8-8869-a18e725299c5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:24.450916 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f980e-aa2b-4537-993e-eebe162e6a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:24.451731 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f980e-aa2b-4537-993e-eebe162e6a70 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:24.452007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f980e-aa2b-4537-993e-eebe162e6a70 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:24.452277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f980e-aa2b-4537-993e-eebe162e6a70 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:24.462191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f980e-aa2b-4537-993e-eebe162e6a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:26:24.469593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-730f980e-aa2b-4537-993e-eebe162e6a70 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:26:24.470774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 539/1087] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Feb 28 10:26:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:24.476861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc0006-705b-4495-b36f-551522c6d63d None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:24.572213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc0006-705b-4495-b36f-551522c6d63d None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:24.604088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db95ed1-1a3a-4e54-97b4-ec6fdccb67da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:24.604738 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db95ed1-1a3a-4e54-97b4-ec6fdccb67da None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:24.605016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db95ed1-1a3a-4e54-97b4-ec6fdccb67da None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:24.605292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db95ed1-1a3a-4e54-97b4-ec6fdccb67da None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:24.606028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db95ed1-1a3a-4e54-97b4-ec6fdccb67da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:24.606326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db95ed1-1a3a-4e54-97b4-ec6fdccb67da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:24.608215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db95ed1-1a3a-4e54-97b4-ec6fdccb67da None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:24.615752 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 549/1088] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Feb 28 10:26:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:24.621355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f980e-aa2b-4537-993e-eebe162e6a70 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:24.668674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dcb76-c3d1-4bd0-9760-2018640fa8c9 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:24.669011 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dcb76-c3d1-4bd0-9760-2018640fa8c9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:24.669239 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dcb76-c3d1-4bd0-9760-2018640fa8c9 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:24.671601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 550/1089] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:26:24.676487 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d520682-9e2c-4bc0-8bb3-0205ebe8ea91 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:24.676769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d520682-9e2c-4bc0-8bb3-0205ebe8ea91 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:24.677038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d520682-9e2c-4bc0-8bb3-0205ebe8ea91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:24.693869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2d520682-9e2c-4bc0-8bb3-0205ebe8ea91 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:24.695079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2d520682-9e2c-4bc0-8bb3-0205ebe8ea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:24.716417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f980e-aa2b-4537-993e-eebe162e6a70 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:24.750386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ae569-cf54-4d76-8ef7-2ff8dc1e8d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:24.751206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ae569-cf54-4d76-8ef7-2ff8dc1e8d8b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:24.751481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ae569-cf54-4d76-8ef7-2ff8dc1e8d8b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:24.751752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ae569-cf54-4d76-8ef7-2ff8dc1e8d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:24.757711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 551/1090] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:24.761850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ae569-cf54-4d76-8ef7-2ff8dc1e8d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:24.763379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ae569-cf54-4d76-8ef7-2ff8dc1e8d8b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:24.780021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-8e2ae569-cf54-4d76-8ef7-2ff8dc1e8d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:26:24.781195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 540/1091] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:24.781911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d520682-9e2c-4bc0-8bb3-0205ebe8ea91 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:24.786631 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ae569-cf54-4d76-8ef7-2ff8dc1e8d8b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:24.876073 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d520682-9e2c-4bc0-8bb3-0205ebe8ea91 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:24.879729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ae569-cf54-4d76-8ef7-2ff8dc1e8d8b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:24.908626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502f426-9cc7-4153-bdf5-6739de36e9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:24.909398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f426-9cc7-4153-bdf5-6739de36e9f7 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:24.909678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f426-9cc7-4153-bdf5-6739de36e9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:24.909949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f426-9cc7-4153-bdf5-6739de36e9f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:24.912514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaac610-125b-4a27-ac8c-5c012607c8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:24.913161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaac610-125b-4a27-ac8c-5c012607c8b1 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:24.913440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaac610-125b-4a27-ac8c-5c012607c8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:24.913713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaac610-125b-4a27-ac8c-5c012607c8b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:24.914420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaac610-125b-4a27-ac8c-5c012607c8b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:24.914726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaac610-125b-4a27-ac8c-5c012607c8b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:24.916115 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaac610-125b-4a27-ac8c-5c012607c8b1 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:24.919654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502f426-9cc7-4153-bdf5-6739de36e9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:26:24.926290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-7502f426-9cc7-4153-bdf5-6739de36e9f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:26:24.926776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 541/1092] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:24.927463 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 552/1093] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:24.932555 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaac610-125b-4a27-ac8c-5c012607c8b1 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:24.934172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502f426-9cc7-4153-bdf5-6739de36e9f7 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:25.029197 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaac610-125b-4a27-ac8c-5c012607c8b1 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:25.033939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502f426-9cc7-4153-bdf5-6739de36e9f7 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:25.059625 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d599fd1-e272-4b5f-8acb-0ab87ca1545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:25.060905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d599fd1-e272-4b5f-8acb-0ab87ca1545f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:25.061168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d599fd1-e272-4b5f-8acb-0ab87ca1545f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:25.061429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d599fd1-e272-4b5f-8acb-0ab87ca1545f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:25.065754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6c736-166b-43a1-a923-5fc3779ef929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:25.066400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6c736-166b-43a1-a923-5fc3779ef929 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:25.066676 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6c736-166b-43a1-a923-5fc3779ef929 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:25.066966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6c736-166b-43a1-a923-5fc3779ef929 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:25.067691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6c736-166b-43a1-a923-5fc3779ef929 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:25.067993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6c736-166b-43a1-a923-5fc3779ef929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:25.068516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d599fd1-e272-4b5f-8acb-0ab87ca1545f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:25.069335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6c736-166b-43a1-a923-5fc3779ef929 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:25.069942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d599fd1-e272-4b5f-8acb-0ab87ca1545f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:25.080039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 553/1094] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:26:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:25.083215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-7d599fd1-e272-4b5f-8acb-0ab87ca1545f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:26:25.083388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6c736-166b-43a1-a923-5fc3779ef929 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:25.084519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 542/1095] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Feb 28 10:26:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:25.089894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d599fd1-e272-4b5f-8acb-0ab87ca1545f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:25.175099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6c736-166b-43a1-a923-5fc3779ef929 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:25.181321 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d599fd1-e272-4b5f-8acb-0ab87ca1545f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:25.206454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b602f-6fc8-4d80-be75-4c9281be4035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:25.207331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b602f-6fc8-4d80-be75-4c9281be4035 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:25.207614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b602f-6fc8-4d80-be75-4c9281be4035 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:25.207883 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b602f-6fc8-4d80-be75-4c9281be4035 None admin] PATH_INFO: `/v3/users/68da65f8ce4c4911b38d8fc21d0fcae3` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:25.209068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b602f-6fc8-4d80-be75-4c9281be4035 None admin] RBAC: Authorizing `identity:get_user(user_id=68da65f8ce4c4911b38d8fc21d0fcae3)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:25.210468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b602f-6fc8-4d80-be75-4c9281be4035 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:25.212077 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 554/1096] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:25 2022] GET /identity/v3/users/68da65f8ce4c4911b38d8fc21d0fcae3 => generated 285 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:25.213415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db3bac-9bb9-44ab-a1e2-154e97d688d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:25.214137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db3bac-9bb9-44ab-a1e2-154e97d688d7 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:25.214487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db3bac-9bb9-44ab-a1e2-154e97d688d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:25.214816 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db3bac-9bb9-44ab-a1e2-154e97d688d7 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:25.215717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db3bac-9bb9-44ab-a1e2-154e97d688d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:25.216014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db3bac-9bb9-44ab-a1e2-154e97d688d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:25.217977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db3bac-9bb9-44ab-a1e2-154e97d688d7 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:25.218089 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b602f-6fc8-4d80-be75-4c9281be4035 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:25.234765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 543/1097] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Feb 28 10:26:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:25.240297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db3bac-9bb9-44ab-a1e2-154e97d688d7 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:25.310238 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b602f-6fc8-4d80-be75-4c9281be4035 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:25.332254 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db3bac-9bb9-44ab-a1e2-154e97d688d7 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:25.341540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45df23-b80c-4f82-8f0f-8cec0ff6372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:25.342166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45df23-b80c-4f82-8f0f-8cec0ff6372a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:25.342442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45df23-b80c-4f82-8f0f-8cec0ff6372a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:25.342728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45df23-b80c-4f82-8f0f-8cec0ff6372a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:25.364278 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072a50f-2d20-43c3-bcc0-860a87301e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:25.364909 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072a50f-2d20-43c3-bcc0-860a87301e20 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:25.365189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072a50f-2d20-43c3-bcc0-860a87301e20 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:25.365469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072a50f-2d20-43c3-bcc0-860a87301e20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:25.404608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45df23-b80c-4f82-8f0f-8cec0ff6372a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:25.406024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45df23-b80c-4f82-8f0f-8cec0ff6372a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:25.429090 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072a50f-2d20-43c3-bcc0-860a87301e20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:25.430492 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072a50f-2d20-43c3-bcc0-860a87301e20 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:25.496095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 555/1098] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:26:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 10:26:25.502397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45df23-b80c-4f82-8f0f-8cec0ff6372a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:25.522921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 544/1099] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:26:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:26:25.528494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072a50f-2d20-43c3-bcc0-860a87301e20 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:25.591882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45df23-b80c-4f82-8f0f-8cec0ff6372a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:25.619291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072a50f-2d20-43c3-bcc0-860a87301e20 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:25.623740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c0d5a-72b2-4a4c-a95b-422d47c6e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:25.624569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c0d5a-72b2-4a4c-a95b-422d47c6e149 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:25.624844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c0d5a-72b2-4a4c-a95b-422d47c6e149 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:25.625113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c0d5a-72b2-4a4c-a95b-422d47c6e149 None admin] PATH_INFO: `/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:25.626269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c0d5a-72b2-4a4c-a95b-422d47c6e149 None admin] RBAC: Authorizing `identity:get_project(project_id=dfd1ccad8e7b4f88851dde03ab864f65)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:25.627695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c0d5a-72b2-4a4c-a95b-422d47c6e149 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:25.629341 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 556/1100] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:26:25 2022] GET /identity/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65 => generated 311 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:25.635428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c0d5a-72b2-4a4c-a95b-422d47c6e149 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:25.652380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1fc0b-ab72-4c09-80f6-0dd719085e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:25.653161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1fc0b-ab72-4c09-80f6-0dd719085e5f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:25.653440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1fc0b-ab72-4c09-80f6-0dd719085e5f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:25.653711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1fc0b-ab72-4c09-80f6-0dd719085e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:25.663273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1fc0b-ab72-4c09-80f6-0dd719085e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:25.664724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1fc0b-ab72-4c09-80f6-0dd719085e5f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:25.680896 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-83c1fc0b-ab72-4c09-80f6-0dd719085e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:26:25.682006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 545/1101] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:26:25.687983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1fc0b-ab72-4c09-80f6-0dd719085e5f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:25.726114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c0d5a-72b2-4a4c-a95b-422d47c6e149 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:25.757251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0329359-3235-4324-8c1f-9428ca625f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:25.757887 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0329359-3235-4324-8c1f-9428ca625f04 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:25.758160 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0329359-3235-4324-8c1f-9428ca625f04 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:25.758428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0329359-3235-4324-8c1f-9428ca625f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:25.759265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0329359-3235-4324-8c1f-9428ca625f04 None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=dfd1ccad8e7b4f88851dde03ab864f65, user.id=68da65f8ce4c4911b38d8fc21d0fcae3) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:25.759822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0329359-3235-4324-8c1f-9428ca625f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:25.761206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0329359-3235-4324-8c1f-9428ca625f04 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:25.767207 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 557/1102] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:26:25 2022] GET /identity/v3/role_assignments?user.id=68da65f8ce4c4911b38d8fc21d0fcae3&scope.project.id=dfd1ccad8e7b4f88851dde03ab864f65&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:25.780715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1fc0b-ab72-4c09-80f6-0dd719085e5f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:25.816335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60131f8-e904-4668-8533-c574d0c47a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:25.817004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60131f8-e904-4668-8533-c574d0c47a85 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:25.817282 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60131f8-e904-4668-8533-c574d0c47a85 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:25.817553 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60131f8-e904-4668-8533-c574d0c47a85 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:25.818280 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60131f8-e904-4668-8533-c574d0c47a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:25.818584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60131f8-e904-4668-8533-c574d0c47a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:25.820014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60131f8-e904-4668-8533-c574d0c47a85 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:25.833147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 546/1103] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:25.838877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0329359-3235-4324-8c1f-9428ca625f04 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:25.940884 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0329359-3235-4324-8c1f-9428ca625f04 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:25.973714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693443b-dd7b-48e2-8715-8862a46a3646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:25.974492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693443b-dd7b-48e2-8715-8862a46a3646 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:25.974768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693443b-dd7b-48e2-8715-8862a46a3646 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:25.975078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693443b-dd7b-48e2-8715-8862a46a3646 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:25.981651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693443b-dd7b-48e2-8715-8862a46a3646 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:25.983616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693443b-dd7b-48e2-8715-8862a46a3646 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:25.996138 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-d693443b-dd7b-48e2-8715-8862a46a3646 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:26:25.997303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 558/1104] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:26:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:26.003975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60131f8-e904-4668-8533-c574d0c47a85 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:26.099532 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60131f8-e904-4668-8533-c574d0c47a85 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:26.131473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc88637-f323-4219-ac29-33fd106b86df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:26.132115 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88637-f323-4219-ac29-33fd106b86df None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:26.132385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88637-f323-4219-ac29-33fd106b86df None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:26.132648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88637-f323-4219-ac29-33fd106b86df None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:26.133404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc88637-f323-4219-ac29-33fd106b86df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:26.133702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc88637-f323-4219-ac29-33fd106b86df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:26.135420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc88637-f323-4219-ac29-33fd106b86df None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:26.147022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 547/1105] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:26:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:26.153051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693443b-dd7b-48e2-8715-8862a46a3646 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:26.249066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693443b-dd7b-48e2-8715-8862a46a3646 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:26.280950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6561f-06b5-4816-97b6-06df52260b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:26.281587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6561f-06b5-4816-97b6-06df52260b3c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:26.281867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6561f-06b5-4816-97b6-06df52260b3c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:26.282138 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6561f-06b5-4816-97b6-06df52260b3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:26.282979 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6561f-06b5-4816-97b6-06df52260b3c None admin] RBAC: Adding query filter params (role.id=790bbad5bfa746499421af10c3bead87, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=b4132c15e66a4a619574f7aba10d6d71) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:26.283289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6561f-06b5-4816-97b6-06df52260b3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:26.285501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6561f-06b5-4816-97b6-06df52260b3c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:26.291224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 559/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:26:26 2022] GET /identity/v3/role_assignments?user.id=b4132c15e66a4a619574f7aba10d6d71&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=790bbad5bfa746499421af10c3bead87 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:28.106068 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d6451-514f-417b-845a-9b6e7926a5e8 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:28.106536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d6451-514f-417b-845a-9b6e7926a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:28.106698 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d6451-514f-417b-845a-9b6e7926a5e8 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:28.109050 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 548/1107] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:28.114194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc4b2-b608-45ee-be1a-776feae8d57a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:28.114618 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc4b2-b608-45ee-be1a-776feae8d57a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:28.114749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc4b2-b608-45ee-be1a-776feae8d57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:28.131075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e79dc4b2-b608-45ee-be1a-776feae8d57a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:28.132251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e79dc4b2-b608-45ee-be1a-776feae8d57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:28.195005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 560/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:28.220883 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d6451-514f-417b-845a-9b6e7926a5e8 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:28.316679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d6451-514f-417b-845a-9b6e7926a5e8 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:28.349552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a8c68-196f-42ec-8b7f-41c167fa6ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:28.350320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8c68-196f-42ec-8b7f-41c167fa6ab5 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:28.350594 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8c68-196f-42ec-8b7f-41c167fa6ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:28.350862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8c68-196f-42ec-8b7f-41c167fa6ab5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:28.352039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a8c68-196f-42ec-8b7f-41c167fa6ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:28.353464 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a8c68-196f-42ec-8b7f-41c167fa6ab5 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:28.355053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 549/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:28.360563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc4b2-b608-45ee-be1a-776feae8d57a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:28.453426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc4b2-b608-45ee-be1a-776feae8d57a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:28.485146 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff645a-d018-4368-b368-42bc68b3e636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:28.485789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff645a-d018-4368-b368-42bc68b3e636 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:28.486073 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff645a-d018-4368-b368-42bc68b3e636 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:28.486350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff645a-d018-4368-b368-42bc68b3e636 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:28.487089 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff645a-d018-4368-b368-42bc68b3e636 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:28.488511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff645a-d018-4368-b368-42bc68b3e636 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:28.508727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 561/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:26:28 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:26:30.791666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7044df-117c-4a9d-af77-ec1b494cd3b7 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:30.792190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7044df-117c-4a9d-af77-ec1b494cd3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:30.792190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7044df-117c-4a9d-af77-ec1b494cd3b7 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:30.793947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 550/1111] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:30.799779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390177-0842-4ce5-8383-7d909c314aca None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:30.800218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390177-0842-4ce5-8383-7d909c314aca None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:30.800343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390177-0842-4ce5-8383-7d909c314aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:30.816711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-11390177-0842-4ce5-8383-7d909c314aca None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:30.817882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-11390177-0842-4ce5-8383-7d909c314aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:30.880688 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 562/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:30.904382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7044df-117c-4a9d-af77-ec1b494cd3b7 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:30.998220 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7044df-117c-4a9d-af77-ec1b494cd3b7 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:31.029463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0057d-7a3b-4043-aa27-c1ba4ae17c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:31.030276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0057d-7a3b-4043-aa27-c1ba4ae17c8b None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:31.030549 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0057d-7a3b-4043-aa27-c1ba4ae17c8b None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:31.030814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0057d-7a3b-4043-aa27-c1ba4ae17c8b None admin] PATH_INFO: `/v3/roles/79396755fc0842a882775515d6feab13` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:31.032259 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0057d-7a3b-4043-aa27-c1ba4ae17c8b None admin] RBAC: Authorizing `identity:get_role(role_id=79396755fc0842a882775515d6feab13)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:31.033601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0057d-7a3b-4043-aa27-c1ba4ae17c8b None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:31.034912 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 551/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:30 2022] GET /identity/v3/roles/79396755fc0842a882775515d6feab13 => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:31.040496 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11390177-0842-4ce5-8383-7d909c314aca None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:31.134043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11390177-0842-4ce5-8383-7d909c314aca None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:31.165911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e2a3-f3c5-493c-b69c-47f3ae3d694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:31.166742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e2a3-f3c5-493c-b69c-47f3ae3d694e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:31.167043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e2a3-f3c5-493c-b69c-47f3ae3d694e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:31.167314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e2a3-f3c5-493c-b69c-47f3ae3d694e None admin] PATH_INFO: `/v3/users/950ab8eda00d4301b27086f22e65d443` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:31.179475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6e2a3-f3c5-493c-b69c-47f3ae3d694e None admin] RBAC: Authorizing `identity:get_user(user_id=950ab8eda00d4301b27086f22e65d443)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:31.180877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6e2a3-f3c5-493c-b69c-47f3ae3d694e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:31.182444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 563/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:31 2022] GET /identity/v3/users/950ab8eda00d4301b27086f22e65d443 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:31.188150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0057d-7a3b-4043-aa27-c1ba4ae17c8b None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:31.280103 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0057d-7a3b-4043-aa27-c1ba4ae17c8b None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:31.311805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1df59c-68da-4464-8f3d-b411ea187f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:31.312418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df59c-68da-4464-8f3d-b411ea187f5c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:31.312687 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df59c-68da-4464-8f3d-b411ea187f5c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:31.312952 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df59c-68da-4464-8f3d-b411ea187f5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:31.373801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1df59c-68da-4464-8f3d-b411ea187f5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:31.375225 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1df59c-68da-4464-8f3d-b411ea187f5c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:31.465517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 552/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:26:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:26:31.471188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e2a3-f3c5-493c-b69c-47f3ae3d694e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:31.563214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e2a3-f3c5-493c-b69c-47f3ae3d694e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:31.594414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36b794-d7e4-4cde-8e8f-c39023419a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:31.595261 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36b794-d7e4-4cde-8e8f-c39023419a22 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:31.595540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36b794-d7e4-4cde-8e8f-c39023419a22 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:31.595809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36b794-d7e4-4cde-8e8f-c39023419a22 None admin] PATH_INFO: `/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:31.596960 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36b794-d7e4-4cde-8e8f-c39023419a22 None admin] RBAC: Authorizing `identity:get_project(project_id=dfd1ccad8e7b4f88851dde03ab864f65)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:31.598352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36b794-d7e4-4cde-8e8f-c39023419a22 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:31.599995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 564/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:26:31 2022] GET /identity/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:31.605744 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1df59c-68da-4464-8f3d-b411ea187f5c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:31.695973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1df59c-68da-4464-8f3d-b411ea187f5c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:31.726856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7d4e3-9205-4c8a-a316-aa9deabb0473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:31.727503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7d4e3-9205-4c8a-a316-aa9deabb0473 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:31.727777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7d4e3-9205-4c8a-a316-aa9deabb0473 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:31.728042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7d4e3-9205-4c8a-a316-aa9deabb0473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:31.728836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7d4e3-9205-4c8a-a316-aa9deabb0473 None admin] RBAC: Adding query filter params (role.id=79396755fc0842a882775515d6feab13, scope.project.id=dfd1ccad8e7b4f88851dde03ab864f65, user.id=950ab8eda00d4301b27086f22e65d443) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:31.729137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7d4e3-9205-4c8a-a316-aa9deabb0473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:31.730514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7d4e3-9205-4c8a-a316-aa9deabb0473 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:31.735610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 553/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:26:31 2022] GET /identity/v3/role_assignments?user.id=950ab8eda00d4301b27086f22e65d443&scope.project.id=dfd1ccad8e7b4f88851dde03ab864f65&role.id=79396755fc0842a882775515d6feab13 => generated 259 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:33.962860 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193f30c-5420-4e31-9ae4-31508ff993df None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:33.963429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193f30c-5420-4e31-9ae4-31508ff993df None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:33.963429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193f30c-5420-4e31-9ae4-31508ff993df None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:33.965194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 565/1118] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:33.970303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a6be-8417-4364-89c2-672618e64545 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:33.970673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a6be-8417-4364-89c2-672618e64545 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:33.970854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a6be-8417-4364-89c2-672618e64545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:33.987172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c1b5a6be-8417-4364-89c2-672618e64545 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:33.988330 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c1b5a6be-8417-4364-89c2-672618e64545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:34.050373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 554/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:34.072703 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193f30c-5420-4e31-9ae4-31508ff993df None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:34.169909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193f30c-5420-4e31-9ae4-31508ff993df None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:34.201377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f3d4-9eca-4e67-b201-105f957adac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:34.202199 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f3d4-9eca-4e67-b201-105f957adac7 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:34.202477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f3d4-9eca-4e67-b201-105f957adac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:34.202747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f3d4-9eca-4e67-b201-105f957adac7 None admin] PATH_INFO: `/v3/roles/79396755fc0842a882775515d6feab13` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:34.204204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427f3d4-9eca-4e67-b201-105f957adac7 None admin] RBAC: Authorizing `identity:get_role(role_id=79396755fc0842a882775515d6feab13)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:34.205539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427f3d4-9eca-4e67-b201-105f957adac7 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:34.206857 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 566/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:34 2022] GET /identity/v3/roles/79396755fc0842a882775515d6feab13 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:34.212494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a6be-8417-4364-89c2-672618e64545 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:34.305484 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a6be-8417-4364-89c2-672618e64545 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:34.337089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28b3b7-54cb-4cff-92b6-971ddbfc69fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:34.337936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b3b7-54cb-4cff-92b6-971ddbfc69fa None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:34.338211 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b3b7-54cb-4cff-92b6-971ddbfc69fa None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:34.338478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28b3b7-54cb-4cff-92b6-971ddbfc69fa None admin] PATH_INFO: `/v3/users/950ab8eda00d4301b27086f22e65d443` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:34.339658 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28b3b7-54cb-4cff-92b6-971ddbfc69fa None admin] RBAC: Authorizing `identity:get_user(user_id=950ab8eda00d4301b27086f22e65d443)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:34.341123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28b3b7-54cb-4cff-92b6-971ddbfc69fa None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:34.342705 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 555/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:34 2022] GET /identity/v3/users/950ab8eda00d4301b27086f22e65d443 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:34.349195 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f3d4-9eca-4e67-b201-105f957adac7 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:34.442087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f3d4-9eca-4e67-b201-105f957adac7 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:34.472887 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770517c-dd1c-486b-b0ad-3d42d88679a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:34.473716 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770517c-dd1c-486b-b0ad-3d42d88679a6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:34.473995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770517c-dd1c-486b-b0ad-3d42d88679a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:34.474268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770517c-dd1c-486b-b0ad-3d42d88679a6 None admin] PATH_INFO: `/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:34.475449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770517c-dd1c-486b-b0ad-3d42d88679a6 None admin] RBAC: Authorizing `identity:get_project(project_id=dfd1ccad8e7b4f88851dde03ab864f65)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:34.476843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770517c-dd1c-486b-b0ad-3d42d88679a6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:34.478463 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 567/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:26:34 2022] GET /identity/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:34.484531 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28b3b7-54cb-4cff-92b6-971ddbfc69fa None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:34.577376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28b3b7-54cb-4cff-92b6-971ddbfc69fa None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:34.609052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169382b0-398c-44c3-9f9c-814ebd36efaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:34.609910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169382b0-398c-44c3-9f9c-814ebd36efaa None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:34.610186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169382b0-398c-44c3-9f9c-814ebd36efaa None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:34.610456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169382b0-398c-44c3-9f9c-814ebd36efaa None admin] PATH_INFO: `/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65/users/950ab8eda00d4301b27086f22e65d443/roles/79396755fc0842a882775515d6feab13` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:34.612622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169382b0-398c-44c3-9f9c-814ebd36efaa None admin] RBAC: Authorizing `identity:create_grant(project_id=dfd1ccad8e7b4f88851dde03ab864f65, user_id=950ab8eda00d4301b27086f22e65d443, role_id=79396755fc0842a882775515d6feab13)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:34.614025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169382b0-398c-44c3-9f9c-814ebd36efaa None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:34.626455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 556/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:26:34 2022] PUT /identity/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65/users/950ab8eda00d4301b27086f22e65d443/roles/79396755fc0842a882775515d6feab13 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:26:36.864351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a091ad7-5ac4-4633-a976-ed14dbcb8a1f None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:36.864909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a091ad7-5ac4-4633-a976-ed14dbcb8a1f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:36.864909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a091ad7-5ac4-4633-a976-ed14dbcb8a1f None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:36.866667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 568/1124] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:36.871952 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b6c33-0545-44b7-8639-3676e63c576e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:36.872352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b6c33-0545-44b7-8639-3676e63c576e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:36.872523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b6c33-0545-44b7-8639-3676e63c576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:36.893834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-af1b6c33-0545-44b7-8639-3676e63c576e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:36.895523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-af1b6c33-0545-44b7-8639-3676e63c576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:36.962552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 557/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:26:36.986626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a091ad7-5ac4-4633-a976-ed14dbcb8a1f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:37.081318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a091ad7-5ac4-4633-a976-ed14dbcb8a1f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:37.113908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f4c7c-bd1d-4891-8b28-2b375657adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:37.114782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4c7c-bd1d-4891-8b28-2b375657adfe None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:37.115054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4c7c-bd1d-4891-8b28-2b375657adfe None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:37.115330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4c7c-bd1d-4891-8b28-2b375657adfe None admin] PATH_INFO: `/v3/roles/79396755fc0842a882775515d6feab13` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:37.116797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f4c7c-bd1d-4891-8b28-2b375657adfe None admin] RBAC: Authorizing `identity:get_role(role_id=79396755fc0842a882775515d6feab13)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:37.118134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f4c7c-bd1d-4891-8b28-2b375657adfe None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:37.119487 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 569/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:36 2022] GET /identity/v3/roles/79396755fc0842a882775515d6feab13 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:37.125358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b6c33-0545-44b7-8639-3676e63c576e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:37.218401 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b6c33-0545-44b7-8639-3676e63c576e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:37.249155 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795fbf8-71f5-4a01-9b83-49acac1d8912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:37.249997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795fbf8-71f5-4a01-9b83-49acac1d8912 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:37.250302 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795fbf8-71f5-4a01-9b83-49acac1d8912 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:37.250569 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795fbf8-71f5-4a01-9b83-49acac1d8912 None admin] PATH_INFO: `/v3/users/950ab8eda00d4301b27086f22e65d443` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:37.251766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795fbf8-71f5-4a01-9b83-49acac1d8912 None admin] RBAC: Authorizing `identity:get_user(user_id=950ab8eda00d4301b27086f22e65d443)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:37.253170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795fbf8-71f5-4a01-9b83-49acac1d8912 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:37.254740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 558/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:37 2022] GET /identity/v3/users/950ab8eda00d4301b27086f22e65d443 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:37.260691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f4c7c-bd1d-4891-8b28-2b375657adfe None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:37.353416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f4c7c-bd1d-4891-8b28-2b375657adfe None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:37.383755 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55b7db-bd7c-4382-ab9d-69444c68cd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:37.384317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55b7db-bd7c-4382-ab9d-69444c68cd0d None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:37.384857 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55b7db-bd7c-4382-ab9d-69444c68cd0d None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:37.385127 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55b7db-bd7c-4382-ab9d-69444c68cd0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:37.446818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55b7db-bd7c-4382-ab9d-69444c68cd0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:37.448241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55b7db-bd7c-4382-ab9d-69444c68cd0d None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:37.539332 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 570/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:26:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:26:37.545118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795fbf8-71f5-4a01-9b83-49acac1d8912 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:37.638280 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795fbf8-71f5-4a01-9b83-49acac1d8912 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:37.669273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b7016-5f42-4bf9-9ebb-8b2ce691e5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:37.670105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7016-5f42-4bf9-9ebb-8b2ce691e5a9 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:37.670378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7016-5f42-4bf9-9ebb-8b2ce691e5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:37.670642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7016-5f42-4bf9-9ebb-8b2ce691e5a9 None admin] PATH_INFO: `/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:37.671894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b7016-5f42-4bf9-9ebb-8b2ce691e5a9 None admin] RBAC: Authorizing `identity:get_project(project_id=dfd1ccad8e7b4f88851dde03ab864f65)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:37.673309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b7016-5f42-4bf9-9ebb-8b2ce691e5a9 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:37.674965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 559/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:26:37 2022] GET /identity/v3/projects/dfd1ccad8e7b4f88851dde03ab864f65 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:37.680665 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55b7db-bd7c-4382-ab9d-69444c68cd0d None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:37.772572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55b7db-bd7c-4382-ab9d-69444c68cd0d None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:37.803392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eaa15b-7b29-4e31-a78f-5a11e3ed267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:37.804007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaa15b-7b29-4e31-a78f-5a11e3ed267e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:37.804285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaa15b-7b29-4e31-a78f-5a11e3ed267e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:37.804562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaa15b-7b29-4e31-a78f-5a11e3ed267e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:37.805368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaa15b-7b29-4e31-a78f-5a11e3ed267e None admin] RBAC: Adding query filter params (role.id=79396755fc0842a882775515d6feab13, scope.project.id=dfd1ccad8e7b4f88851dde03ab864f65, user.id=950ab8eda00d4301b27086f22e65d443) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:37.805673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaa15b-7b29-4e31-a78f-5a11e3ed267e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:37.807085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaa15b-7b29-4e31-a78f-5a11e3ed267e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:37.813042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 571/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:26:37 2022] GET /identity/v3/role_assignments?user.id=950ab8eda00d4301b27086f22e65d443&scope.project.id=dfd1ccad8e7b4f88851dde03ab864f65&role.id=79396755fc0842a882775515d6feab13 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:40.110224 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016ef25-6079-4afb-8eea-04eb6e04ea70 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:40.110628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016ef25-6079-4afb-8eea-04eb6e04ea70 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:40.110764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016ef25-6079-4afb-8eea-04eb6e04ea70 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:40.112598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 560/1131] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:40.117873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af1a5-5e08-40d9-b661-82e22626cadf None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:40.118273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af1a5-5e08-40d9-b661-82e22626cadf None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:40.118422 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af1a5-5e08-40d9-b661-82e22626cadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:40.134815 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-617af1a5-5e08-40d9-b661-82e22626cadf None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:40.136006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-617af1a5-5e08-40d9-b661-82e22626cadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:40.197615 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 572/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:40.221504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016ef25-6079-4afb-8eea-04eb6e04ea70 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:40.319278 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016ef25-6079-4afb-8eea-04eb6e04ea70 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:40.351572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9a4fe-c885-4912-9579-4deec498619a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:40.352342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9a4fe-c885-4912-9579-4deec498619a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:40.352617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9a4fe-c885-4912-9579-4deec498619a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:40.352883 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9a4fe-c885-4912-9579-4deec498619a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:40.354031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9a4fe-c885-4912-9579-4deec498619a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:40.355477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9a4fe-c885-4912-9579-4deec498619a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:40.357097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 561/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:40.362930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617af1a5-5e08-40d9-b661-82e22626cadf None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:40.456045 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617af1a5-5e08-40d9-b661-82e22626cadf None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:40.487819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74823892-eab5-495d-9dda-9197d9491ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:40.488463 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74823892-eab5-495d-9dda-9197d9491ae3 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:40.488748 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74823892-eab5-495d-9dda-9197d9491ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:40.489027 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74823892-eab5-495d-9dda-9197d9491ae3 None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:40.489730 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74823892-eab5-495d-9dda-9197d9491ae3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:40.491169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74823892-eab5-495d-9dda-9197d9491ae3 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:40.516154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 573/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:26:40 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:26:42.794765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b215a3-82be-4551-b779-b3875c2619cf None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:42.795353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b215a3-82be-4551-b779-b3875c2619cf None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:42.795353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b215a3-82be-4551-b779-b3875c2619cf None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:42.797122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 562/1135] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:42.802303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707942fe-c4bb-4bfd-bd02-76397ec97eae None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:42.802691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707942fe-c4bb-4bfd-bd02-76397ec97eae None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:42.802859 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707942fe-c4bb-4bfd-bd02-76397ec97eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:42.819662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-707942fe-c4bb-4bfd-bd02-76397ec97eae None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:42.820827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-707942fe-c4bb-4bfd-bd02-76397ec97eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:42.883221 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 574/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:42.908064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b215a3-82be-4551-b779-b3875c2619cf None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:43.003977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b215a3-82be-4551-b779-b3875c2619cf None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:43.035818 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a37357-5609-4315-a650-a44259a64fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:43.036583 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a37357-5609-4315-a650-a44259a64fd4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:43.036858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a37357-5609-4315-a650-a44259a64fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:43.037122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a37357-5609-4315-a650-a44259a64fd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:43.038274 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a37357-5609-4315-a650-a44259a64fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:43.039718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a37357-5609-4315-a650-a44259a64fd4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:43.041282 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 563/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:43.046741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707942fe-c4bb-4bfd-bd02-76397ec97eae None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:43.139617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707942fe-c4bb-4bfd-bd02-76397ec97eae None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:43.170985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b25fef-ce7d-4cca-a54b-e71706f7cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:43.171629 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b25fef-ce7d-4cca-a54b-e71706f7cf33 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:43.171902 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b25fef-ce7d-4cca-a54b-e71706f7cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:43.172167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b25fef-ce7d-4cca-a54b-e71706f7cf33 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:43.172852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b25fef-ce7d-4cca-a54b-e71706f7cf33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:43.174323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b25fef-ce7d-4cca-a54b-e71706f7cf33 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:43.192873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 575/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:26:43 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:26:45.483824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac227a-62d3-4775-b708-8db52e922159 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:45.484367 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac227a-62d3-4775-b708-8db52e922159 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:45.484367 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac227a-62d3-4775-b708-8db52e922159 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:45.486115 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 564/1139] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:45.491288 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b204d5-2102-47e6-938a-27b559337c93 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:45.491713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b204d5-2102-47e6-938a-27b559337c93 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:45.491839 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b204d5-2102-47e6-938a-27b559337c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:45.508651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-a9b204d5-2102-47e6-938a-27b559337c93 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:45.510062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a9b204d5-2102-47e6-938a-27b559337c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:45.571564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 576/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:45.593802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac227a-62d3-4775-b708-8db52e922159 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:45.687871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac227a-62d3-4775-b708-8db52e922159 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:45.718246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1870e2-1d83-4616-99d2-98eadc41183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:45.719024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1870e2-1d83-4616-99d2-98eadc41183e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:45.719297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1870e2-1d83-4616-99d2-98eadc41183e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:45.719561 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1870e2-1d83-4616-99d2-98eadc41183e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:45.728919 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1870e2-1d83-4616-99d2-98eadc41183e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:26:45.736183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-de1870e2-1d83-4616-99d2-98eadc41183e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:26:45.737252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 565/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:26:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:45.743080 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b204d5-2102-47e6-938a-27b559337c93 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:45.835056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b204d5-2102-47e6-938a-27b559337c93 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:45.866706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e93dc-82df-42df-a44f-437baf67ff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:45.867374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e93dc-82df-42df-a44f-437baf67ff1b None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:45.867654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e93dc-82df-42df-a44f-437baf67ff1b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:45.867925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e93dc-82df-42df-a44f-437baf67ff1b None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:45.868648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e93dc-82df-42df-a44f-437baf67ff1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:45.868948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e93dc-82df-42df-a44f-437baf67ff1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:45.870290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e93dc-82df-42df-a44f-437baf67ff1b None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:45.878418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 577/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:26:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:45.883811 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1870e2-1d83-4616-99d2-98eadc41183e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:45.977157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1870e2-1d83-4616-99d2-98eadc41183e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:46.008531 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc5f6-2d32-4307-9ddc-88ce76014c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:46.009313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc5f6-2d32-4307-9ddc-88ce76014c0a None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:46.009840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc5f6-2d32-4307-9ddc-88ce76014c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:46.010105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc5f6-2d32-4307-9ddc-88ce76014c0a None admin] PATH_INFO: `/v3/users/04356f114b68408a85dee615127e1b72` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:46.022336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dc5f6-2d32-4307-9ddc-88ce76014c0a None admin] RBAC: Authorizing `identity:get_user(user_id=04356f114b68408a85dee615127e1b72)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:46.023789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dc5f6-2d32-4307-9ddc-88ce76014c0a None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:46.025384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 566/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:45 2022] GET /identity/v3/users/04356f114b68408a85dee615127e1b72 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:46.031496 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e93dc-82df-42df-a44f-437baf67ff1b None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:46.125562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e93dc-82df-42df-a44f-437baf67ff1b None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:46.157317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90670c50-c63c-45fd-b6e4-63607abda024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:46.157940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90670c50-c63c-45fd-b6e4-63607abda024 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:46.158221 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90670c50-c63c-45fd-b6e4-63607abda024 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:46.158494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90670c50-c63c-45fd-b6e4-63607abda024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:46.220185 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90670c50-c63c-45fd-b6e4-63607abda024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:46.221598 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90670c50-c63c-45fd-b6e4-63607abda024 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:46.311519 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 578/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:26:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:26:46.317184 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc5f6-2d32-4307-9ddc-88ce76014c0a None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:46.409908 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc5f6-2d32-4307-9ddc-88ce76014c0a None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:46.441626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d60348-511b-430d-91f7-ece738eb645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:46.442489 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d60348-511b-430d-91f7-ece738eb645d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:46.442766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d60348-511b-430d-91f7-ece738eb645d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:46.443072 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d60348-511b-430d-91f7-ece738eb645d None admin] PATH_INFO: `/v3/projects/344c3f6b75844ec79f6dfcdc944dce49` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:46.444220 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d60348-511b-430d-91f7-ece738eb645d None admin] RBAC: Authorizing `identity:get_project(project_id=344c3f6b75844ec79f6dfcdc944dce49)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:46.445633 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d60348-511b-430d-91f7-ece738eb645d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:46.447296 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 567/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:26:46 2022] GET /identity/v3/projects/344c3f6b75844ec79f6dfcdc944dce49 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:46.453578 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90670c50-c63c-45fd-b6e4-63607abda024 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:46.545351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90670c50-c63c-45fd-b6e4-63607abda024 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:46.577214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496b326-4a3b-41ae-8cfe-0803cac856df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:46.577778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496b326-4a3b-41ae-8cfe-0803cac856df None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:46.578051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496b326-4a3b-41ae-8cfe-0803cac856df None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:46.578316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496b326-4a3b-41ae-8cfe-0803cac856df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:46.579169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496b326-4a3b-41ae-8cfe-0803cac856df None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=344c3f6b75844ec79f6dfcdc944dce49, user.id=04356f114b68408a85dee615127e1b72) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:46.579469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496b326-4a3b-41ae-8cfe-0803cac856df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:46.580845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496b326-4a3b-41ae-8cfe-0803cac856df None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:46.585887 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 579/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:26:46 2022] GET /identity/v3/role_assignments?user.id=04356f114b68408a85dee615127e1b72&scope.project.id=344c3f6b75844ec79f6dfcdc944dce49&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:48.806685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c047-df7f-44bf-a72d-ae9702505059 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:48.807255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c047-df7f-44bf-a72d-ae9702505059 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:48.807255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c047-df7f-44bf-a72d-ae9702505059 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:48.809513 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 568/1147] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:48.814837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0c1a-64bf-46d1-9c95-4795e45134fd None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:48.815294 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0c1a-64bf-46d1-9c95-4795e45134fd None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:48.815422 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0c1a-64bf-46d1-9c95-4795e45134fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:48.832320 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-94de0c1a-64bf-46d1-9c95-4795e45134fd None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:48.833491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-94de0c1a-64bf-46d1-9c95-4795e45134fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:48.896689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 580/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:48.918881 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4c047-df7f-44bf-a72d-ae9702505059 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:49.013935 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4c047-df7f-44bf-a72d-ae9702505059 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:49.044894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46fca5-15e2-4cc2-9d94-13fcbb0a9ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:49.045660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46fca5-15e2-4cc2-9d94-13fcbb0a9ea6 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:49.045934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46fca5-15e2-4cc2-9d94-13fcbb0a9ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:49.046201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46fca5-15e2-4cc2-9d94-13fcbb0a9ea6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:49.055616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46fca5-15e2-4cc2-9d94-13fcbb0a9ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:26:49.062868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-2b46fca5-15e2-4cc2-9d94-13fcbb0a9ea6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:26:49.063980 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 569/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:49.069802 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0c1a-64bf-46d1-9c95-4795e45134fd None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:49.163276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0c1a-64bf-46d1-9c95-4795e45134fd None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:49.195449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1ce7b-fc8e-4d5e-9a72-6d5d5e69d146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:49.196098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1ce7b-fc8e-4d5e-9a72-6d5d5e69d146 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:49.196378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1ce7b-fc8e-4d5e-9a72-6d5d5e69d146 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:49.196652 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1ce7b-fc8e-4d5e-9a72-6d5d5e69d146 None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:49.197384 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1ce7b-fc8e-4d5e-9a72-6d5d5e69d146 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:49.197687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1ce7b-fc8e-4d5e-9a72-6d5d5e69d146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:49.199064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1ce7b-fc8e-4d5e-9a72-6d5d5e69d146 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:49.207202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 581/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:49.212862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46fca5-15e2-4cc2-9d94-13fcbb0a9ea6 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:49.306994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46fca5-15e2-4cc2-9d94-13fcbb0a9ea6 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:49.338742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdda4a-d896-451e-8d73-d84682271159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:49.339554 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdda4a-d896-451e-8d73-d84682271159 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:49.339827 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdda4a-d896-451e-8d73-d84682271159 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:49.340091 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdda4a-d896-451e-8d73-d84682271159 None admin] PATH_INFO: `/v3/users/04356f114b68408a85dee615127e1b72` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:49.341323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdda4a-d896-451e-8d73-d84682271159 None admin] RBAC: Authorizing `identity:get_user(user_id=04356f114b68408a85dee615127e1b72)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:49.342749 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdda4a-d896-451e-8d73-d84682271159 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:49.344343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 570/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:49 2022] GET /identity/v3/users/04356f114b68408a85dee615127e1b72 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:49.349882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1ce7b-fc8e-4d5e-9a72-6d5d5e69d146 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:49.447789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1ce7b-fc8e-4d5e-9a72-6d5d5e69d146 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:49.479224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb334a-6e4b-476a-ab80-1f3df32b7c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:49.480056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb334a-6e4b-476a-ab80-1f3df32b7c06 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:49.480334 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb334a-6e4b-476a-ab80-1f3df32b7c06 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:49.480606 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb334a-6e4b-476a-ab80-1f3df32b7c06 None admin] PATH_INFO: `/v3/projects/344c3f6b75844ec79f6dfcdc944dce49` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:49.482297 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb334a-6e4b-476a-ab80-1f3df32b7c06 None admin] RBAC: Authorizing `identity:get_project(project_id=344c3f6b75844ec79f6dfcdc944dce49)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:49.483739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb334a-6e4b-476a-ab80-1f3df32b7c06 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:49.485401 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 582/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:26:49 2022] GET /identity/v3/projects/344c3f6b75844ec79f6dfcdc944dce49 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:49.491353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdda4a-d896-451e-8d73-d84682271159 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:49.586060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdda4a-d896-451e-8d73-d84682271159 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:49.618446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe101-37de-4615-a20e-c6374e6d8b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:49.619345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe101-37de-4615-a20e-c6374e6d8b07 None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:49.619623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe101-37de-4615-a20e-c6374e6d8b07 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:49.619894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe101-37de-4615-a20e-c6374e6d8b07 None admin] PATH_INFO: `/v3/projects/344c3f6b75844ec79f6dfcdc944dce49/users/04356f114b68408a85dee615127e1b72/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:49.621854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fe101-37de-4615-a20e-c6374e6d8b07 None admin] RBAC: Authorizing `identity:create_grant(project_id=344c3f6b75844ec79f6dfcdc944dce49, user_id=04356f114b68408a85dee615127e1b72, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:49.623325 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fe101-37de-4615-a20e-c6374e6d8b07 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:49.636189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 571/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:26:49 2022] PUT /identity/v3/projects/344c3f6b75844ec79f6dfcdc944dce49/users/04356f114b68408a85dee615127e1b72/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:26:51.909146 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f019d-8ea8-4f25-a2bc-eaaac233efd0 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:51.909706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f019d-8ea8-4f25-a2bc-eaaac233efd0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:51.909706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f019d-8ea8-4f25-a2bc-eaaac233efd0 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:51.911468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 583/1154] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:51.916717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede305c-718a-41fd-b201-2d90558157c5 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:51.917123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede305c-718a-41fd-b201-2d90558157c5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:51.917268 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede305c-718a-41fd-b201-2d90558157c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:51.933589 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-eede305c-718a-41fd-b201-2d90558157c5 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:51.935314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-eede305c-718a-41fd-b201-2d90558157c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:51.998471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 572/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:52.022232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f019d-8ea8-4f25-a2bc-eaaac233efd0 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:52.117262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f019d-8ea8-4f25-a2bc-eaaac233efd0 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:52.149797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671726d-9038-4519-8b8a-bae169346159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:52.150592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671726d-9038-4519-8b8a-bae169346159 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:52.150868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671726d-9038-4519-8b8a-bae169346159 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:52.151170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671726d-9038-4519-8b8a-bae169346159 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:52.160835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671726d-9038-4519-8b8a-bae169346159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:26:52.167604 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-d671726d-9038-4519-8b8a-bae169346159 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:26:52.169249 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 584/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:26:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:52.175172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede305c-718a-41fd-b201-2d90558157c5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:52.266810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede305c-718a-41fd-b201-2d90558157c5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:52.298363 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f809a21-5924-4f4b-a947-8fd8827f105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:52.299031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f809a21-5924-4f4b-a947-8fd8827f105c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:52.299309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f809a21-5924-4f4b-a947-8fd8827f105c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:52.299578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f809a21-5924-4f4b-a947-8fd8827f105c None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:52.300301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f809a21-5924-4f4b-a947-8fd8827f105c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:52.300601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f809a21-5924-4f4b-a947-8fd8827f105c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:52.301950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f809a21-5924-4f4b-a947-8fd8827f105c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:52.310148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 573/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:52.315460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671726d-9038-4519-8b8a-bae169346159 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:52.407728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671726d-9038-4519-8b8a-bae169346159 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:52.439273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd371a1-28ba-4387-b919-f53c6e8ce045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:52.440052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd371a1-28ba-4387-b919-f53c6e8ce045 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:52.440328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd371a1-28ba-4387-b919-f53c6e8ce045 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:52.440598 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd371a1-28ba-4387-b919-f53c6e8ce045 None admin] PATH_INFO: `/v3/users/04356f114b68408a85dee615127e1b72` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:52.441757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd371a1-28ba-4387-b919-f53c6e8ce045 None admin] RBAC: Authorizing `identity:get_user(user_id=04356f114b68408a85dee615127e1b72)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:52.443187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd371a1-28ba-4387-b919-f53c6e8ce045 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:52.444727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 585/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:26:52 2022] GET /identity/v3/users/04356f114b68408a85dee615127e1b72 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:26:52.450666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f809a21-5924-4f4b-a947-8fd8827f105c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:52.544819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f809a21-5924-4f4b-a947-8fd8827f105c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:52.575831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dd781-ca2d-4046-b452-8f32bbf5d214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:52.576454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dd781-ca2d-4046-b452-8f32bbf5d214 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:52.576730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dd781-ca2d-4046-b452-8f32bbf5d214 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:52.576997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dd781-ca2d-4046-b452-8f32bbf5d214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:52.638789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88dd781-ca2d-4046-b452-8f32bbf5d214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:52.640228 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88dd781-ca2d-4046-b452-8f32bbf5d214 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:52.729583 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 574/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:26:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:26:52.735650 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd371a1-28ba-4387-b919-f53c6e8ce045 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:52.826779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd371a1-28ba-4387-b919-f53c6e8ce045 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:52.859212 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300ddea-8471-48a9-b0a2-23c0b0c253ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:52.860031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300ddea-8471-48a9-b0a2-23c0b0c253ff None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:52.860308 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300ddea-8471-48a9-b0a2-23c0b0c253ff None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:52.860578 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300ddea-8471-48a9-b0a2-23c0b0c253ff None admin] PATH_INFO: `/v3/projects/344c3f6b75844ec79f6dfcdc944dce49` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:52.861741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300ddea-8471-48a9-b0a2-23c0b0c253ff None admin] RBAC: Authorizing `identity:get_project(project_id=344c3f6b75844ec79f6dfcdc944dce49)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:52.863178 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300ddea-8471-48a9-b0a2-23c0b0c253ff None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:52.864818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 586/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:26:52 2022] GET /identity/v3/projects/344c3f6b75844ec79f6dfcdc944dce49 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:52.870886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dd781-ca2d-4046-b452-8f32bbf5d214 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:52.963721 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dd781-ca2d-4046-b452-8f32bbf5d214 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:53.119868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb25c0-ba6e-4fc0-a361-d0334feb2dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:53.120505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb25c0-ba6e-4fc0-a361-d0334feb2dbd None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:53.120780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb25c0-ba6e-4fc0-a361-d0334feb2dbd None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:53.121049 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb25c0-ba6e-4fc0-a361-d0334feb2dbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:53.122468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb25c0-ba6e-4fc0-a361-d0334feb2dbd None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=344c3f6b75844ec79f6dfcdc944dce49, user.id=04356f114b68408a85dee615127e1b72) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:53.122769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb25c0-ba6e-4fc0-a361-d0334feb2dbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:53.124194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb25c0-ba6e-4fc0-a361-d0334feb2dbd None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:53.129723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 575/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:26:52 2022] GET /identity/v3/role_assignments?user.id=04356f114b68408a85dee615127e1b72&scope.project.id=344c3f6b75844ec79f6dfcdc944dce49&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:55.502419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf92865-a71b-4d48-b87c-14a04783b638 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:55.502999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf92865-a71b-4d48-b87c-14a04783b638 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:55.502999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf92865-a71b-4d48-b87c-14a04783b638 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:55.504780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 587/1162] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:55.510288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb38d4-6a89-4cc0-87bf-a2b5ca4f8514 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:55.510684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb38d4-6a89-4cc0-87bf-a2b5ca4f8514 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:55.510825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb38d4-6a89-4cc0-87bf-a2b5ca4f8514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:55.527500 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-5adb38d4-6a89-4cc0-87bf-a2b5ca4f8514 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:55.528656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5adb38d4-6a89-4cc0-87bf-a2b5ca4f8514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:55.590020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 576/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:55.611754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf92865-a71b-4d48-b87c-14a04783b638 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:55.707832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf92865-a71b-4d48-b87c-14a04783b638 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:55.738836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec8f9f-dad3-4a57-bbbd-0d3dc0af490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:55.739477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec8f9f-dad3-4a57-bbbd-0d3dc0af490e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:55.739752 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec8f9f-dad3-4a57-bbbd-0d3dc0af490e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:55.740019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec8f9f-dad3-4a57-bbbd-0d3dc0af490e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:55.802715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec8f9f-dad3-4a57-bbbd-0d3dc0af490e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:55.804109 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec8f9f-dad3-4a57-bbbd-0d3dc0af490e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:55.894522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 588/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:26:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:26:55.900286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb38d4-6a89-4cc0-87bf-a2b5ca4f8514 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:55.990704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb38d4-6a89-4cc0-87bf-a2b5ca4f8514 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:56.022165 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ce7bc-e560-4550-92ef-3d74efc847df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:56.022956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ce7bc-e560-4550-92ef-3d74efc847df None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:56.023236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ce7bc-e560-4550-92ef-3d74efc847df None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:56.023506 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ce7bc-e560-4550-92ef-3d74efc847df None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:56.029866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ce7bc-e560-4550-92ef-3d74efc847df None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:56.031309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ce7bc-e560-4550-92ef-3d74efc847df None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:56.045132 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-ce6ce7bc-e560-4550-92ef-3d74efc847df None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 28 10:26:56.046242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 577/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Feb 28 10:26:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:26:56.052004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec8f9f-dad3-4a57-bbbd-0d3dc0af490e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:56.144808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec8f9f-dad3-4a57-bbbd-0d3dc0af490e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:56.176495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f566f9f-d647-4c1a-be2c-34a5ea2c0a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:56.177135 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f566f9f-d647-4c1a-be2c-34a5ea2c0a63 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:56.177417 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f566f9f-d647-4c1a-be2c-34a5ea2c0a63 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:56.177693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f566f9f-d647-4c1a-be2c-34a5ea2c0a63 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:56.178404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f566f9f-d647-4c1a-be2c-34a5ea2c0a63 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:26:56.178711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f566f9f-d647-4c1a-be2c-34a5ea2c0a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:56.180090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f566f9f-d647-4c1a-be2c-34a5ea2c0a63 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:56.187517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 589/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Feb 28 10:26:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:26:58.448706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f444-83e4-4ec8-a241-e022653948d8 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:58.449240 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f444-83e4-4ec8-a241-e022653948d8 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:58.449339 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f444-83e4-4ec8-a241-e022653948d8 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:58.451164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 578/1167] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:58.456401 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36587fe3-8829-4332-a996-c3a9efa7c27b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:58.456839 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36587fe3-8829-4332-a996-c3a9efa7c27b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:58.456943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36587fe3-8829-4332-a996-c3a9efa7c27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:58.473226 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-36587fe3-8829-4332-a996-c3a9efa7c27b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:58.474379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-36587fe3-8829-4332-a996-c3a9efa7c27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:58.536789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 590/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:26:58.559714 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9f444-83e4-4ec8-a241-e022653948d8 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:58.653716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9f444-83e4-4ec8-a241-e022653948d8 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:58.686037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95072d-595f-4a56-adef-7292e3d72bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:58.686688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95072d-595f-4a56-adef-7292e3d72bf3 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:58.686996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95072d-595f-4a56-adef-7292e3d72bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:58.687267 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95072d-595f-4a56-adef-7292e3d72bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:58.687986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95072d-595f-4a56-adef-7292e3d72bf3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:58.689333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95072d-595f-4a56-adef-7292e3d72bf3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:58.703336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 579/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Mon Feb 28 10:26:58 2022] POST /identity/v3/domains => generated 267 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:27:00.971037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4986f5-ea4b-4726-920f-5147dee25829 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:00.971563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4986f5-ea4b-4726-920f-5147dee25829 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:00.971563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4986f5-ea4b-4726-920f-5147dee25829 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:00.973328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 591/1170] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:27:00.978434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a32d2-d373-4db7-b3ac-4b5a2fafbc55 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:00.978836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a32d2-d373-4db7-b3ac-4b5a2fafbc55 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:00.979015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a32d2-d373-4db7-b3ac-4b5a2fafbc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:00.996847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-eb2a32d2-d373-4db7-b3ac-4b5a2fafbc55 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:27:00.998060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-eb2a32d2-d373-4db7-b3ac-4b5a2fafbc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:27:01.060247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 580/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:27:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:27:01.084276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4986f5-ea4b-4726-920f-5147dee25829 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:01.177524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4986f5-ea4b-4726-920f-5147dee25829 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:01.209037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2638e5-fbec-49e2-bdf8-e29ef0a930ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:01.209869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2638e5-fbec-49e2-bdf8-e29ef0a930ef None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:01.210148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2638e5-fbec-49e2-bdf8-e29ef0a930ef None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:01.210422 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2638e5-fbec-49e2-bdf8-e29ef0a930ef None admin] PATH_INFO: `/v3/domains/78ba786849f84637a0791f5df00777a9` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:01.220856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2638e5-fbec-49e2-bdf8-e29ef0a930ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=78ba786849f84637a0791f5df00777a9)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:01.222326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2638e5-fbec-49e2-bdf8-e29ef0a930ef None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:01.223886 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 592/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Mon Feb 28 10:27:01 2022] GET /identity/v3/domains/78ba786849f84637a0791f5df00777a9 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:27:01.229423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a32d2-d373-4db7-b3ac-4b5a2fafbc55 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:01.320717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a32d2-d373-4db7-b3ac-4b5a2fafbc55 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:01.353118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3056cc-9ccd-4cc5-b435-4c634af4b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:01.353752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3056cc-9ccd-4cc5-b435-4c634af4b3d5 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:01.354025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3056cc-9ccd-4cc5-b435-4c634af4b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:01.354294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3056cc-9ccd-4cc5-b435-4c634af4b3d5 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:01.355019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3056cc-9ccd-4cc5-b435-4c634af4b3d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:01.356462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3056cc-9ccd-4cc5-b435-4c634af4b3d5 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:01.379777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 581/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:27:01 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:27:03.651459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b6b8-c1b6-493a-b108-6b5d26b0f991 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:03.652008 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b6b8-c1b6-493a-b108-6b5d26b0f991 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:03.652008 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b6b8-c1b6-493a-b108-6b5d26b0f991 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:03.653778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 593/1174] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:27:03.658864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8042-cdc3-49b9-ac27-a1c134f0dfd9 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:03.659319 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8042-cdc3-49b9-ac27-a1c134f0dfd9 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:03.659424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8042-cdc3-49b9-ac27-a1c134f0dfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:03.676004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-95dc8042-cdc3-49b9-ac27-a1c134f0dfd9 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:27:03.677148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-95dc8042-cdc3-49b9-ac27-a1c134f0dfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:27:03.738036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 582/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:27:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:27:03.762264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b6b8-c1b6-493a-b108-6b5d26b0f991 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:03.858098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b6b8-c1b6-493a-b108-6b5d26b0f991 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:03.889420 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5ca05-3571-4720-ab06-c7395229fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:03.890251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5ca05-3571-4720-ab06-c7395229fb16 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:03.890532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5ca05-3571-4720-ab06-c7395229fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:03.890805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5ca05-3571-4720-ab06-c7395229fb16 None admin] PATH_INFO: `/v3/domains/78ba786849f84637a0791f5df00777a9` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:03.891999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5ca05-3571-4720-ab06-c7395229fb16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=78ba786849f84637a0791f5df00777a9)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:03.893412 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5ca05-3571-4720-ab06-c7395229fb16 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:03.894984 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 594/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Mon Feb 28 10:27:03 2022] GET /identity/v3/domains/78ba786849f84637a0791f5df00777a9 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:27:03.900411 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc8042-cdc3-49b9-ac27-a1c134f0dfd9 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:03.990983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc8042-cdc3-49b9-ac27-a1c134f0dfd9 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:04.021623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295ae5f-a91c-474a-841b-65e4e6120085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:04.022254 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295ae5f-a91c-474a-841b-65e4e6120085 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:04.022526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295ae5f-a91c-474a-841b-65e4e6120085 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:04.022790 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295ae5f-a91c-474a-841b-65e4e6120085 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:04.023496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295ae5f-a91c-474a-841b-65e4e6120085 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:04.024888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295ae5f-a91c-474a-841b-65e4e6120085 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:04.044882 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 583/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:27:03 2022] POST /identity/v3/users => generated 311 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:27:06.339693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f51f7b-0dc9-4f61-8190-ad891e571144 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:06.340222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f51f7b-0dc9-4f61-8190-ad891e571144 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:06.340222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f51f7b-0dc9-4f61-8190-ad891e571144 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:06.341953 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 595/1178] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:27:06.347109 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7341d-9e75-407b-b13a-5a5ea3bbc098 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:06.347533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7341d-9e75-407b-b13a-5a5ea3bbc098 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:06.347639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7341d-9e75-407b-b13a-5a5ea3bbc098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:06.364307 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c3e7341d-9e75-407b-b13a-5a5ea3bbc098 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:27:06.365452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c3e7341d-9e75-407b-b13a-5a5ea3bbc098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:27:06.430281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 584/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:27:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:27:06.453276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f51f7b-0dc9-4f61-8190-ad891e571144 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:06.548952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f51f7b-0dc9-4f61-8190-ad891e571144 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:06.579789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ebe7a-70e8-43a8-b949-68a94e06f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:06.580546 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ebe7a-70e8-43a8-b949-68a94e06f12b None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:06.580825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ebe7a-70e8-43a8-b949-68a94e06f12b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:06.581096 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ebe7a-70e8-43a8-b949-68a94e06f12b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:06.591225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ebe7a-70e8-43a8-b949-68a94e06f12b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:27:06.597918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-745ebe7a-70e8-43a8-b949-68a94e06f12b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:27:06.599079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 596/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:27:06.606011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7341d-9e75-407b-b13a-5a5ea3bbc098 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:06.704490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7341d-9e75-407b-b13a-5a5ea3bbc098 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:06.735272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb9ed-8baa-4df9-879d-482c0b275d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:06.735922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb9ed-8baa-4df9-879d-482c0b275d6e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:06.736198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb9ed-8baa-4df9-879d-482c0b275d6e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:06.736466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb9ed-8baa-4df9-879d-482c0b275d6e None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:06.737192 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cb9ed-8baa-4df9-879d-482c0b275d6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:27:06.737488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cb9ed-8baa-4df9-879d-482c0b275d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:06.738846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cb9ed-8baa-4df9-879d-482c0b275d6e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:06.746979 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 585/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:27:06.752715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ebe7a-70e8-43a8-b949-68a94e06f12b None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:06.845869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ebe7a-70e8-43a8-b949-68a94e06f12b None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:06.877327 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0198fa-e4b0-46ec-a0a1-ac78051e34b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:06.878157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0198fa-e4b0-46ec-a0a1-ac78051e34b7 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:06.878436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0198fa-e4b0-46ec-a0a1-ac78051e34b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:06.878705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0198fa-e4b0-46ec-a0a1-ac78051e34b7 None admin] PATH_INFO: `/v3/users/cc18fd151d0743e1bfeecf2a2ecdeccc` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:06.891966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0198fa-e4b0-46ec-a0a1-ac78051e34b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cc18fd151d0743e1bfeecf2a2ecdeccc)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:06.893387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0198fa-e4b0-46ec-a0a1-ac78051e34b7 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:06.894993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 597/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:27:06 2022] GET /identity/v3/users/cc18fd151d0743e1bfeecf2a2ecdeccc => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:27:06.900453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb9ed-8baa-4df9-879d-482c0b275d6e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:07.003367 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb9ed-8baa-4df9-879d-482c0b275d6e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:07.039306 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1b1d9-8e6f-4799-b121-103ec5fd2b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:07.039936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b1d9-8e6f-4799-b121-103ec5fd2b7e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:07.040209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b1d9-8e6f-4799-b121-103ec5fd2b7e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:07.040476 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b1d9-8e6f-4799-b121-103ec5fd2b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:07.104581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1b1d9-8e6f-4799-b121-103ec5fd2b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:07.105992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1b1d9-8e6f-4799-b121-103ec5fd2b7e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:07.196176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 586/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:27:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:27:07.202050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0198fa-e4b0-46ec-a0a1-ac78051e34b7 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:07.296154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0198fa-e4b0-46ec-a0a1-ac78051e34b7 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:07.327622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cca2f5-73c1-4385-8746-d76075f96d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:07.328443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cca2f5-73c1-4385-8746-d76075f96d61 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:07.328721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cca2f5-73c1-4385-8746-d76075f96d61 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:07.328990 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cca2f5-73c1-4385-8746-d76075f96d61 None admin] PATH_INFO: `/v3/projects/90039d1a8d884ccaa37db52944151146` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:07.330149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cca2f5-73c1-4385-8746-d76075f96d61 None admin] RBAC: Authorizing `identity:get_project(project_id=90039d1a8d884ccaa37db52944151146)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:07.331586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cca2f5-73c1-4385-8746-d76075f96d61 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:07.333221 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 598/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:27:07 2022] GET /identity/v3/projects/90039d1a8d884ccaa37db52944151146 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:27:07.339137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1b1d9-8e6f-4799-b121-103ec5fd2b7e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:07.432716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1b1d9-8e6f-4799-b121-103ec5fd2b7e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:07.463411 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08803a3d-b922-4a85-8447-c2f344023228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:07.464044 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803a3d-b922-4a85-8447-c2f344023228 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:07.464318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803a3d-b922-4a85-8447-c2f344023228 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:07.465106 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803a3d-b922-4a85-8447-c2f344023228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:07.465913 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08803a3d-b922-4a85-8447-c2f344023228 None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=90039d1a8d884ccaa37db52944151146, user.id=cc18fd151d0743e1bfeecf2a2ecdeccc) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:27:07.466214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08803a3d-b922-4a85-8447-c2f344023228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:07.467644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08803a3d-b922-4a85-8447-c2f344023228 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:07.472703 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 587/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:27:07 2022] GET /identity/v3/role_assignments?user.id=cc18fd151d0743e1bfeecf2a2ecdeccc&scope.project.id=90039d1a8d884ccaa37db52944151146&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:27:09.721530 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a47f-c13d-4499-89c6-baa8141be8f7 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:09.722067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a47f-c13d-4499-89c6-baa8141be8f7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:09.722067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a47f-c13d-4499-89c6-baa8141be8f7 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:09.723856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 599/1186] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:27:09.728963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0687-bdbd-498e-83b2-35745a254747 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:09.729397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0687-bdbd-498e-83b2-35745a254747 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:09.729497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0687-bdbd-498e-83b2-35745a254747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:09.746192 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a14d0687-bdbd-498e-83b2-35745a254747 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:27:09.747389 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a14d0687-bdbd-498e-83b2-35745a254747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:27:09.811189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 588/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:27:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:27:09.833957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62a47f-c13d-4499-89c6-baa8141be8f7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:09.928688 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62a47f-c13d-4499-89c6-baa8141be8f7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:09.960280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4583102-2562-4bba-811d-9cfc101e9b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:09.961042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4583102-2562-4bba-811d-9cfc101e9b40 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:09.961320 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4583102-2562-4bba-811d-9cfc101e9b40 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:09.961590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4583102-2562-4bba-811d-9cfc101e9b40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:09.971342 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4583102-2562-4bba-811d-9cfc101e9b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:27:09.978131 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-b4583102-2562-4bba-811d-9cfc101e9b40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:27:09.979262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 600/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:27:09.985601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d0687-bdbd-498e-83b2-35745a254747 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:10.077547 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d0687-bdbd-498e-83b2-35745a254747 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:10.109685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cc459-383f-4473-b129-f9eb46666c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:10.110343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cc459-383f-4473-b129-f9eb46666c53 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:10.110616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cc459-383f-4473-b129-f9eb46666c53 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:10.110884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cc459-383f-4473-b129-f9eb46666c53 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:10.111634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cc459-383f-4473-b129-f9eb46666c53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:27:10.111930 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cc459-383f-4473-b129-f9eb46666c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:10.113287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cc459-383f-4473-b129-f9eb46666c53 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:10.121486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 589/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:27:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:27:10.127440 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4583102-2562-4bba-811d-9cfc101e9b40 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:10.220179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4583102-2562-4bba-811d-9cfc101e9b40 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:10.251248 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be74e09-4ad4-4f41-bfeb-500f3975a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:10.252027 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be74e09-4ad4-4f41-bfeb-500f3975a254 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:10.252304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be74e09-4ad4-4f41-bfeb-500f3975a254 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:10.252574 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be74e09-4ad4-4f41-bfeb-500f3975a254 None admin] PATH_INFO: `/v3/users/cc18fd151d0743e1bfeecf2a2ecdeccc` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:10.253737 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be74e09-4ad4-4f41-bfeb-500f3975a254 None admin] RBAC: Authorizing `identity:get_user(user_id=cc18fd151d0743e1bfeecf2a2ecdeccc)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:10.255175 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be74e09-4ad4-4f41-bfeb-500f3975a254 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:10.256742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 601/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:27:10 2022] GET /identity/v3/users/cc18fd151d0743e1bfeecf2a2ecdeccc => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:27:10.262424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cc459-383f-4473-b129-f9eb46666c53 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:10.354018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cc459-383f-4473-b129-f9eb46666c53 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:10.385130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe3ab2-7d9a-4ced-8500-bb976eee4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:10.385953 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe3ab2-7d9a-4ced-8500-bb976eee4ead None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:10.386256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe3ab2-7d9a-4ced-8500-bb976eee4ead None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:10.386532 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe3ab2-7d9a-4ced-8500-bb976eee4ead None admin] PATH_INFO: `/v3/projects/90039d1a8d884ccaa37db52944151146` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:10.387704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe3ab2-7d9a-4ced-8500-bb976eee4ead None admin] RBAC: Authorizing `identity:get_project(project_id=90039d1a8d884ccaa37db52944151146)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:10.389106 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe3ab2-7d9a-4ced-8500-bb976eee4ead None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:10.390731 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 590/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:27:10 2022] GET /identity/v3/projects/90039d1a8d884ccaa37db52944151146 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:27:10.396425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be74e09-4ad4-4f41-bfeb-500f3975a254 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:10.495040 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be74e09-4ad4-4f41-bfeb-500f3975a254 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:10.526581 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40592da1-5c74-46fb-8c19-91b30ce8b281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:10.527963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40592da1-5c74-46fb-8c19-91b30ce8b281 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:10.528243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40592da1-5c74-46fb-8c19-91b30ce8b281 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:10.528516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40592da1-5c74-46fb-8c19-91b30ce8b281 None admin] PATH_INFO: `/v3/projects/90039d1a8d884ccaa37db52944151146/users/cc18fd151d0743e1bfeecf2a2ecdeccc/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:10.530483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40592da1-5c74-46fb-8c19-91b30ce8b281 None admin] RBAC: Authorizing `identity:create_grant(project_id=90039d1a8d884ccaa37db52944151146, user_id=cc18fd151d0743e1bfeecf2a2ecdeccc, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:10.531936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40592da1-5c74-46fb-8c19-91b30ce8b281 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:10.544220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 602/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:27:10 2022] PUT /identity/v3/projects/90039d1a8d884ccaa37db52944151146/users/cc18fd151d0743e1bfeecf2a2ecdeccc/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:27:12.793424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f21ba-84ad-4ad4-a29d-7578179a964b None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:12.793990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f21ba-84ad-4ad4-a29d-7578179a964b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:12.793990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f21ba-84ad-4ad4-a29d-7578179a964b None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:12.795802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 591/1193] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:27:12.801113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da93d6-21e7-4487-b789-700ee8931083 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:12.801509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da93d6-21e7-4487-b789-700ee8931083 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:12.801670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da93d6-21e7-4487-b789-700ee8931083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:12.818679 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-35da93d6-21e7-4487-b789-700ee8931083 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:27:12.819903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-35da93d6-21e7-4487-b789-700ee8931083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:27:12.882591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 603/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:27:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:27:12.906239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f21ba-84ad-4ad4-a29d-7578179a964b None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:13.002631 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f21ba-84ad-4ad4-a29d-7578179a964b None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:13.034759 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf84291-7cc5-4944-aaa5-fc4cb5f58b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:13.035565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf84291-7cc5-4944-aaa5-fc4cb5f58b37 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:13.035842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf84291-7cc5-4944-aaa5-fc4cb5f58b37 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:13.036110 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf84291-7cc5-4944-aaa5-fc4cb5f58b37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:13.046239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf84291-7cc5-4944-aaa5-fc4cb5f58b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:27:13.052878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-3bf84291-7cc5-4944-aaa5-fc4cb5f58b37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:27:13.054024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 592/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:27:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:27:13.060747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da93d6-21e7-4487-b789-700ee8931083 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:13.154503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da93d6-21e7-4487-b789-700ee8931083 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:13.186442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dc6a1-0e11-4280-88f5-749f8b5f47cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:13.187122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dc6a1-0e11-4280-88f5-749f8b5f47cc None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:13.187405 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dc6a1-0e11-4280-88f5-749f8b5f47cc None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:13.187683 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dc6a1-0e11-4280-88f5-749f8b5f47cc None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:13.188415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dc6a1-0e11-4280-88f5-749f8b5f47cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:27:13.188722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dc6a1-0e11-4280-88f5-749f8b5f47cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:13.190079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dc6a1-0e11-4280-88f5-749f8b5f47cc None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:13.197722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 604/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:27:13.203477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf84291-7cc5-4944-aaa5-fc4cb5f58b37 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:13.297230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf84291-7cc5-4944-aaa5-fc4cb5f58b37 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:13.327794 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963960f-c205-4033-94b1-d6738a56330f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:13.328622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963960f-c205-4033-94b1-d6738a56330f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:13.328891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963960f-c205-4033-94b1-d6738a56330f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:13.329150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963960f-c205-4033-94b1-d6738a56330f None admin] PATH_INFO: `/v3/users/cc18fd151d0743e1bfeecf2a2ecdeccc` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:13.330294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963960f-c205-4033-94b1-d6738a56330f None admin] RBAC: Authorizing `identity:get_user(user_id=cc18fd151d0743e1bfeecf2a2ecdeccc)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:13.331716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963960f-c205-4033-94b1-d6738a56330f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:13.333295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 593/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Feb 28 10:27:13 2022] GET /identity/v3/users/cc18fd151d0743e1bfeecf2a2ecdeccc => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:27:13.339211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dc6a1-0e11-4280-88f5-749f8b5f47cc None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:13.434796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dc6a1-0e11-4280-88f5-749f8b5f47cc None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:13.466169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e4f27-c784-4cdf-9402-d5fa41b3b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:13.466791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e4f27-c784-4cdf-9402-d5fa41b3b0b0 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:13.467097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e4f27-c784-4cdf-9402-d5fa41b3b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:13.467375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e4f27-c784-4cdf-9402-d5fa41b3b0b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:13.530701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e4f27-c784-4cdf-9402-d5fa41b3b0b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:13.532151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e4f27-c784-4cdf-9402-d5fa41b3b0b0 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:13.622235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 605/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:27:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:27:13.628008 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963960f-c205-4033-94b1-d6738a56330f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:13.720963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963960f-c205-4033-94b1-d6738a56330f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:13.754047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e03787-0dc2-49c5-82c7-a9f4ba491d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:13.754870 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e03787-0dc2-49c5-82c7-a9f4ba491d95 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:13.755170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e03787-0dc2-49c5-82c7-a9f4ba491d95 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:13.755436 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e03787-0dc2-49c5-82c7-a9f4ba491d95 None admin] PATH_INFO: `/v3/projects/90039d1a8d884ccaa37db52944151146` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:13.756578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e03787-0dc2-49c5-82c7-a9f4ba491d95 None admin] RBAC: Authorizing `identity:get_project(project_id=90039d1a8d884ccaa37db52944151146)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:13.757979 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e03787-0dc2-49c5-82c7-a9f4ba491d95 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:13.759893 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 594/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Feb 28 10:27:13 2022] GET /identity/v3/projects/90039d1a8d884ccaa37db52944151146 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:27:13.766259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e4f27-c784-4cdf-9402-d5fa41b3b0b0 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:13.865297 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e4f27-c784-4cdf-9402-d5fa41b3b0b0 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:13.897255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c674c81-60bd-4484-acd8-8c4141e0d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:13.897824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674c81-60bd-4484-acd8-8c4141e0d53a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:13.898102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674c81-60bd-4484-acd8-8c4141e0d53a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:13.898371 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674c81-60bd-4484-acd8-8c4141e0d53a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:13.899209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c674c81-60bd-4484-acd8-8c4141e0d53a None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=90039d1a8d884ccaa37db52944151146, user.id=cc18fd151d0743e1bfeecf2a2ecdeccc) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:27:13.899515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c674c81-60bd-4484-acd8-8c4141e0d53a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:13.900912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c674c81-60bd-4484-acd8-8c4141e0d53a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:13.906985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 606/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:27:13 2022] GET /identity/v3/role_assignments?user.id=cc18fd151d0743e1bfeecf2a2ecdeccc&scope.project.id=90039d1a8d884ccaa37db52944151146&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:15.053392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf5380-905b-4fb0-969d-eaf4f142100c None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:15.054023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf5380-905b-4fb0-969d-eaf4f142100c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:15.054023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf5380-905b-4fb0-969d-eaf4f142100c None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:15.056154 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 595/1201] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:28:15.062248 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c0209-1ba7-426e-be84-cd7c483515e3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:15.062834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c0209-1ba7-426e-be84-cd7c483515e3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:15.062834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c0209-1ba7-426e-be84-cd7c483515e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:15.088323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-7c4c0209-1ba7-426e-be84-cd7c483515e3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:28:15.090385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7c4c0209-1ba7-426e-be84-cd7c483515e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:28:15.189547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 607/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:28:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:28:15.206993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf5380-905b-4fb0-969d-eaf4f142100c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:15.340400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf5380-905b-4fb0-969d-eaf4f142100c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:15.379648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73949-4bf2-4ef9-8f91-591fb5381809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:15.380836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73949-4bf2-4ef9-8f91-591fb5381809 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:15.381130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73949-4bf2-4ef9-8f91-591fb5381809 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:15.381526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73949-4bf2-4ef9-8f91-591fb5381809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:15.394990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad73949-4bf2-4ef9-8f91-591fb5381809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:15.396541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad73949-4bf2-4ef9-8f91-591fb5381809 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:15.417793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-aad73949-4bf2-4ef9-8f91-591fb5381809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:15.421434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 596/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:15.425164 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c0209-1ba7-426e-be84-cd7c483515e3 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:15.567091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c0209-1ba7-426e-be84-cd7c483515e3 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:15.619429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2c62e-f95e-4baf-8630-e9ad0d82fa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:15.620460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2c62e-f95e-4baf-8630-e9ad0d82fa1f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:15.620961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2c62e-f95e-4baf-8630-e9ad0d82fa1f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:15.621419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2c62e-f95e-4baf-8630-e9ad0d82fa1f None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:15.622430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2c62e-f95e-4baf-8630-e9ad0d82fa1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:15.622764 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2c62e-f95e-4baf-8630-e9ad0d82fa1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:15.624320 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2c62e-f95e-4baf-8630-e9ad0d82fa1f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:15.637983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 608/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:15.644542 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73949-4bf2-4ef9-8f91-591fb5381809 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:15.775089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73949-4bf2-4ef9-8f91-591fb5381809 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:15.812940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aaeba-bc0f-4c19-b43d-b185d3ce429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:15.814677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aaeba-bc0f-4c19-b43d-b185d3ce429f None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:15.814677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aaeba-bc0f-4c19-b43d-b185d3ce429f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:15.814677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aaeba-bc0f-4c19-b43d-b185d3ce429f None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:15.815144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aaeba-bc0f-4c19-b43d-b185d3ce429f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:15.816556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aaeba-bc0f-4c19-b43d-b185d3ce429f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:15.843847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 597/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Feb 28 10:28:15 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:28:18.425773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a0fed-7a28-476c-8aa7-f51dadfe544e None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:18.426312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a0fed-7a28-476c-8aa7-f51dadfe544e None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:18.426312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a0fed-7a28-476c-8aa7-f51dadfe544e None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:18.428308 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 609/1206] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:28:18.436183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c42a81-5c6f-4e37-a997-7ba51f4ec9d2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:18.436183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c42a81-5c6f-4e37-a997-7ba51f4ec9d2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:18.436183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c42a81-5c6f-4e37-a997-7ba51f4ec9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:18.454463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-59c42a81-5c6f-4e37-a997-7ba51f4ec9d2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:28:18.455874 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-59c42a81-5c6f-4e37-a997-7ba51f4ec9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:28:18.533116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 598/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:28:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:28:18.559719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a0fed-7a28-476c-8aa7-f51dadfe544e None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:18.678019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a0fed-7a28-476c-8aa7-f51dadfe544e None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:18.720755 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80618a4c-f4f3-4a0e-93b8-327a47d9eb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:18.721705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80618a4c-f4f3-4a0e-93b8-327a47d9eb99 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:18.722097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80618a4c-f4f3-4a0e-93b8-327a47d9eb99 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:18.722375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80618a4c-f4f3-4a0e-93b8-327a47d9eb99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:18.734464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80618a4c-f4f3-4a0e-93b8-327a47d9eb99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:28:18.743292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-80618a4c-f4f3-4a0e-93b8-327a47d9eb99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:28:18.750830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 610/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:28:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:18.754522 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c42a81-5c6f-4e37-a997-7ba51f4ec9d2 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:18.871108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c42a81-5c6f-4e37-a997-7ba51f4ec9d2 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:18.909854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd75f3-ba2b-408c-950b-2fd1f340d387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:18.910517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd75f3-ba2b-408c-950b-2fd1f340d387 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:18.910797 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd75f3-ba2b-408c-950b-2fd1f340d387 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:18.911104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd75f3-ba2b-408c-950b-2fd1f340d387 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:18.911832 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd75f3-ba2b-408c-950b-2fd1f340d387 None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:18.912135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd75f3-ba2b-408c-950b-2fd1f340d387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:18.913497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd75f3-ba2b-408c-950b-2fd1f340d387 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:18.926320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 599/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:28:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:18.927744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80618a4c-f4f3-4a0e-93b8-327a47d9eb99 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:19.043453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80618a4c-f4f3-4a0e-93b8-327a47d9eb99 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:19.088255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ab11-ee30-461b-9506-3f3e9dbb7101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:19.089881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ab11-ee30-461b-9506-3f3e9dbb7101 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:19.090166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ab11-ee30-461b-9506-3f3e9dbb7101 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:19.090436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ab11-ee30-461b-9506-3f3e9dbb7101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:19.102603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65ab11-ee30-461b-9506-3f3e9dbb7101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:19.104095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65ab11-ee30-461b-9506-3f3e9dbb7101 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:19.124608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-1d65ab11-ee30-461b-9506-3f3e9dbb7101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:19.126936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 611/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:28:19.132275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd75f3-ba2b-408c-950b-2fd1f340d387 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:19.241977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd75f3-ba2b-408c-950b-2fd1f340d387 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:19.278343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab3dc-744b-4c86-8cb7-4d317adb43a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:19.279036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab3dc-744b-4c86-8cb7-4d317adb43a3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:19.279316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab3dc-744b-4c86-8cb7-4d317adb43a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:19.279583 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab3dc-744b-4c86-8cb7-4d317adb43a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:19.280292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ab3dc-744b-4c86-8cb7-4d317adb43a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:19.280586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ab3dc-744b-4c86-8cb7-4d317adb43a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:19.282022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ab3dc-744b-4c86-8cb7-4d317adb43a3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:19.296137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 600/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:28:19.301561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ab11-ee30-461b-9506-3f3e9dbb7101 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:19.411859 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ab11-ee30-461b-9506-3f3e9dbb7101 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:19.448897 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff752592-ca42-45c4-9ea3-7265699dc1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:19.450437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff752592-ca42-45c4-9ea3-7265699dc1a7 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:19.450718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff752592-ca42-45c4-9ea3-7265699dc1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:19.451019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff752592-ca42-45c4-9ea3-7265699dc1a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:19.459594 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff752592-ca42-45c4-9ea3-7265699dc1a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:19.461236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff752592-ca42-45c4-9ea3-7265699dc1a7 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:19.477038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-ff752592-ca42-45c4-9ea3-7265699dc1a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:28:19.478321 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 612/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:19.484391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab3dc-744b-4c86-8cb7-4d317adb43a3 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:19.597955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab3dc-744b-4c86-8cb7-4d317adb43a3 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:19.631838 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5a02a-098b-4bfc-84da-31d9b3efcd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:19.632673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5a02a-098b-4bfc-84da-31d9b3efcd54 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:19.633060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5a02a-098b-4bfc-84da-31d9b3efcd54 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:19.633423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5a02a-098b-4bfc-84da-31d9b3efcd54 None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:19.634621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5a02a-098b-4bfc-84da-31d9b3efcd54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:19.635034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5a02a-098b-4bfc-84da-31d9b3efcd54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:19.637281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5a02a-098b-4bfc-84da-31d9b3efcd54 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:19.655308 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 601/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Feb 28 10:28:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:28:19.660903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff752592-ca42-45c4-9ea3-7265699dc1a7 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:19.762484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff752592-ca42-45c4-9ea3-7265699dc1a7 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:19.797547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2cbfd-b23d-4cf7-96f1-8873a5b9b919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:19.798714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2cbfd-b23d-4cf7-96f1-8873a5b9b919 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:19.798714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2cbfd-b23d-4cf7-96f1-8873a5b9b919 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:19.799067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2cbfd-b23d-4cf7-96f1-8873a5b9b919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:19.869037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2cbfd-b23d-4cf7-96f1-8873a5b9b919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:19.871261 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2cbfd-b23d-4cf7-96f1-8873a5b9b919 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:19.982845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 613/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:28:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 10:28:19.983973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5a02a-098b-4bfc-84da-31d9b3efcd54 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:20.097788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5a02a-098b-4bfc-84da-31d9b3efcd54 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:20.132769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7365ec4-682b-4df0-917c-1f23eb65f937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:20.133535 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7365ec4-682b-4df0-917c-1f23eb65f937 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:20.134058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7365ec4-682b-4df0-917c-1f23eb65f937 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:20.134321 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7365ec4-682b-4df0-917c-1f23eb65f937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:20.145125 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7365ec4-682b-4df0-917c-1f23eb65f937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:20.147035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7365ec4-682b-4df0-917c-1f23eb65f937 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:20.164343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-a7365ec4-682b-4df0-917c-1f23eb65f937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:20.165646 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 602/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:20.171424 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2cbfd-b23d-4cf7-96f1-8873a5b9b919 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:20.285283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2cbfd-b23d-4cf7-96f1-8873a5b9b919 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:20.323839 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd100a-a9dd-4d36-a6b8-236619edc6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:20.324614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd100a-a9dd-4d36-a6b8-236619edc6af None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:20.324849 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd100a-a9dd-4d36-a6b8-236619edc6af None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:20.325146 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd100a-a9dd-4d36-a6b8-236619edc6af None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:20.325908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd100a-a9dd-4d36-a6b8-236619edc6af None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:20.326247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd100a-a9dd-4d36-a6b8-236619edc6af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:20.327720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd100a-a9dd-4d36-a6b8-236619edc6af None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:20.344444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 614/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:20.348302 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7365ec4-682b-4df0-917c-1f23eb65f937 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:20.454451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7365ec4-682b-4df0-917c-1f23eb65f937 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:20.494759 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ab82e-64d9-49cb-ae36-1c8887b6b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:20.496132 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ab82e-64d9-49cb-ae36-1c8887b6b35e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:20.496387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ab82e-64d9-49cb-ae36-1c8887b6b35e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:20.496693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ab82e-64d9-49cb-ae36-1c8887b6b35e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:20.503978 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ab82e-64d9-49cb-ae36-1c8887b6b35e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:20.505579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ab82e-64d9-49cb-ae36-1c8887b6b35e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:20.519270 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-b70ab82e-64d9-49cb-ae36-1c8887b6b35e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:28:20.520808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 603/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:28:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:20.526726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd100a-a9dd-4d36-a6b8-236619edc6af None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:20.639640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd100a-a9dd-4d36-a6b8-236619edc6af None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:20.675908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d7057-770e-4f5b-95aa-592ffbc2822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:20.676560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d7057-770e-4f5b-95aa-592ffbc2822f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:20.676853 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d7057-770e-4f5b-95aa-592ffbc2822f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:20.677203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d7057-770e-4f5b-95aa-592ffbc2822f None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:20.677874 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d7057-770e-4f5b-95aa-592ffbc2822f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:20.678209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d7057-770e-4f5b-95aa-592ffbc2822f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:20.679682 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d7057-770e-4f5b-95aa-592ffbc2822f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:20.702588 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 615/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:28:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:20.704641 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ab82e-64d9-49cb-ae36-1c8887b6b35e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:20.806876 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ab82e-64d9-49cb-ae36-1c8887b6b35e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:20.841805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbbf47-69c3-42bb-a240-47abc7211a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:20.842494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbbf47-69c3-42bb-a240-47abc7211a5d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:20.842809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbbf47-69c3-42bb-a240-47abc7211a5d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:20.843082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbbf47-69c3-42bb-a240-47abc7211a5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:20.843943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbbf47-69c3-42bb-a240-47abc7211a5d None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=ee30c8013ebb40a99d1eac7820d7f1f8) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:20.844195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbbf47-69c3-42bb-a240-47abc7211a5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:20.845699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbbf47-69c3-42bb-a240-47abc7211a5d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:20.851593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 604/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:28:20 2022] GET /identity/v3/role_assignments?user.id=ee30c8013ebb40a99d1eac7820d7f1f8&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:23.211795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762ccd-acc3-414c-a5f9-49a8b36c7b43 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:23.212557 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762ccd-acc3-414c-a5f9-49a8b36c7b43 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:23.212557 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762ccd-acc3-414c-a5f9-49a8b36c7b43 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:23.215368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 616/1220] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:28:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:28:23.221312 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18c2bc-a8fe-41a4-a2c8-a7b3ab368429 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:23.221826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18c2bc-a8fe-41a4-a2c8-a7b3ab368429 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:23.221826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18c2bc-a8fe-41a4-a2c8-a7b3ab368429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:23.240314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-de18c2bc-a8fe-41a4-a2c8-a7b3ab368429 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:28:23.241525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-de18c2bc-a8fe-41a4-a2c8-a7b3ab368429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:28:23.315282 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 605/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:28:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:28:23.341016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762ccd-acc3-414c-a5f9-49a8b36c7b43 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:23.452941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762ccd-acc3-414c-a5f9-49a8b36c7b43 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:23.487209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ed228-c497-417e-82ca-d3ccdfb6ed67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:23.488053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ed228-c497-417e-82ca-d3ccdfb6ed67 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:23.488330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ed228-c497-417e-82ca-d3ccdfb6ed67 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:23.488600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ed228-c497-417e-82ca-d3ccdfb6ed67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:23.498872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ed228-c497-417e-82ca-d3ccdfb6ed67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:28:23.505971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-379ed228-c497-417e-82ca-d3ccdfb6ed67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:28:23.507173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 617/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:23.514763 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18c2bc-a8fe-41a4-a2c8-a7b3ab368429 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:23.623409 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18c2bc-a8fe-41a4-a2c8-a7b3ab368429 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:23.661003 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25da18c-dfcc-43fa-9bf6-8d0670730b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:23.661666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25da18c-dfcc-43fa-9bf6-8d0670730b3f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:23.661942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25da18c-dfcc-43fa-9bf6-8d0670730b3f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:23.662210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25da18c-dfcc-43fa-9bf6-8d0670730b3f None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:23.662970 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25da18c-dfcc-43fa-9bf6-8d0670730b3f None admin] RBAC: Adding query filter params (name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:23.663277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25da18c-dfcc-43fa-9bf6-8d0670730b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:23.664638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25da18c-dfcc-43fa-9bf6-8d0670730b3f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:23.672824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 606/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:23.678757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ed228-c497-417e-82ca-d3ccdfb6ed67 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:23.786423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ed228-c497-417e-82ca-d3ccdfb6ed67 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:23.820824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d329c6-54f8-468e-b1dc-c98dba3f91f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:23.821608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d329c6-54f8-468e-b1dc-c98dba3f91f6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:23.821890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d329c6-54f8-468e-b1dc-c98dba3f91f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:23.822166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d329c6-54f8-468e-b1dc-c98dba3f91f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:23.834138 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d329c6-54f8-468e-b1dc-c98dba3f91f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:23.835830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d329c6-54f8-468e-b1dc-c98dba3f91f6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:23.853933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-17d329c6-54f8-468e-b1dc-c98dba3f91f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:23.855739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 618/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:23.861695 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25da18c-dfcc-43fa-9bf6-8d0670730b3f None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:23.978674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25da18c-dfcc-43fa-9bf6-8d0670730b3f None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:24.025256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaf36b-7530-4090-835e-a8bd41cf8470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:24.027499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaf36b-7530-4090-835e-a8bd41cf8470 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:24.027951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaf36b-7530-4090-835e-a8bd41cf8470 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:24.028365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaf36b-7530-4090-835e-a8bd41cf8470 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:24.029889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aaf36b-7530-4090-835e-a8bd41cf8470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:24.030445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aaf36b-7530-4090-835e-a8bd41cf8470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:24.033177 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aaf36b-7530-4090-835e-a8bd41cf8470 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:24.053158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 607/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:24.058776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d329c6-54f8-468e-b1dc-c98dba3f91f6 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:24.166052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d329c6-54f8-468e-b1dc-c98dba3f91f6 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:24.200048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238619a4-7940-4c22-b138-7b3f3c630a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:24.200840 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238619a4-7940-4c22-b138-7b3f3c630a14 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:24.201118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238619a4-7940-4c22-b138-7b3f3c630a14 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:24.201385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238619a4-7940-4c22-b138-7b3f3c630a14 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:24.210307 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238619a4-7940-4c22-b138-7b3f3c630a14 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:24.211889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238619a4-7940-4c22-b138-7b3f3c630a14 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:24.226315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-238619a4-7940-4c22-b138-7b3f3c630a14 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:28:24.227521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 619/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:24.233629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaf36b-7530-4090-835e-a8bd41cf8470 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:24.334689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaf36b-7530-4090-835e-a8bd41cf8470 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:24.370920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2a3d1-0788-4611-aabe-d8e94033d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:24.371600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2a3d1-0788-4611-aabe-d8e94033d77d None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:24.371876 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2a3d1-0788-4611-aabe-d8e94033d77d None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:24.372144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2a3d1-0788-4611-aabe-d8e94033d77d None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:24.372969 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2a3d1-0788-4611-aabe-d8e94033d77d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:24.373275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2a3d1-0788-4611-aabe-d8e94033d77d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:24.374931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2a3d1-0788-4611-aabe-d8e94033d77d None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:24.398805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 608/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Feb 28 10:28:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:24.403772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238619a4-7940-4c22-b138-7b3f3c630a14 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:24.508912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238619a4-7940-4c22-b138-7b3f3c630a14 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:24.551404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4412575-3a4e-403e-a416-deee8f28deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:24.552943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4412575-3a4e-403e-a416-deee8f28deb1 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:24.553417 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4412575-3a4e-403e-a416-deee8f28deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:24.554002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4412575-3a4e-403e-a416-deee8f28deb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:24.567838 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4412575-3a4e-403e-a416-deee8f28deb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:24.569254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4412575-3a4e-403e-a416-deee8f28deb1 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:24.585977 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-b4412575-3a4e-403e-a416-deee8f28deb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:24.587181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 620/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:28:24.593000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2a3d1-0788-4611-aabe-d8e94033d77d None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:24.697246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2a3d1-0788-4611-aabe-d8e94033d77d None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:24.734418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781e7cc-10fe-4006-b3fb-a6dbdc26ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:24.735127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e7cc-10fe-4006-b3fb-a6dbdc26ac92 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:24.735456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e7cc-10fe-4006-b3fb-a6dbdc26ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:24.735748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e7cc-10fe-4006-b3fb-a6dbdc26ac92 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:24.736606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781e7cc-10fe-4006-b3fb-a6dbdc26ac92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:24.736929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781e7cc-10fe-4006-b3fb-a6dbdc26ac92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:24.738480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781e7cc-10fe-4006-b3fb-a6dbdc26ac92 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:24.751853 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 609/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:24.757523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4412575-3a4e-403e-a416-deee8f28deb1 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:24.860621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4412575-3a4e-403e-a416-deee8f28deb1 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:24.896673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32de8e-d848-40b5-9ec7-b9daf121f39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:24.897460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32de8e-d848-40b5-9ec7-b9daf121f39a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:24.897745 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32de8e-d848-40b5-9ec7-b9daf121f39a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:24.898019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32de8e-d848-40b5-9ec7-b9daf121f39a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:24.905353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32de8e-d848-40b5-9ec7-b9daf121f39a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:24.906789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32de8e-d848-40b5-9ec7-b9daf121f39a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:24.920503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-ed32de8e-d848-40b5-9ec7-b9daf121f39a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:28:24.921661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 621/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:28:24.927536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781e7cc-10fe-4006-b3fb-a6dbdc26ac92 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:25.034797 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781e7cc-10fe-4006-b3fb-a6dbdc26ac92 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:25.071639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a344c-695a-4e59-9b57-39150de418c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:25.072346 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a344c-695a-4e59-9b57-39150de418c0 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:25.072678 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a344c-695a-4e59-9b57-39150de418c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:25.073691 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a344c-695a-4e59-9b57-39150de418c0 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:25.074587 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a344c-695a-4e59-9b57-39150de418c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:25.075022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a344c-695a-4e59-9b57-39150de418c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:25.076618 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a344c-695a-4e59-9b57-39150de418c0 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:25.089478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 610/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:28:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:25.095825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32de8e-d848-40b5-9ec7-b9daf121f39a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:25.200340 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32de8e-d848-40b5-9ec7-b9daf121f39a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:25.233737 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e7e29-1875-4fa0-9e46-5a5fabb77355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:25.234620 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e7e29-1875-4fa0-9e46-5a5fabb77355 None admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:25.234918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e7e29-1875-4fa0-9e46-5a5fabb77355 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:25.235206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e7e29-1875-4fa0-9e46-5a5fabb77355 None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/ee30c8013ebb40a99d1eac7820d7f1f8/roles/19a2df51b7b646478ee4f4f466082cab` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:25.249987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e7e29-1875-4fa0-9e46-5a5fabb77355 None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=ee30c8013ebb40a99d1eac7820d7f1f8, role_id=19a2df51b7b646478ee4f4f466082cab)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:25.251476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e7e29-1875-4fa0-9e46-5a5fabb77355 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:25.264126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 622/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:28:25 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/ee30c8013ebb40a99d1eac7820d7f1f8/roles/19a2df51b7b646478ee4f4f466082cab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:28:27.736320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd0b0-ac51-47a4-bf6b-4baa293aeb18 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:27.736845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd0b0-ac51-47a4-bf6b-4baa293aeb18 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:27.737230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd0b0-ac51-47a4-bf6b-4baa293aeb18 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:27.740728 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 611/1233] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:28:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:28:27.747726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df630c-b14b-489d-a5fc-f3a00f370eb3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:27.748163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df630c-b14b-489d-a5fc-f3a00f370eb3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:27.748446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df630c-b14b-489d-a5fc-f3a00f370eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:27.766343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-22df630c-b14b-489d-a5fc-f3a00f370eb3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:28:27.767592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-22df630c-b14b-489d-a5fc-f3a00f370eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:28:27.841592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 623/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:28:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:28:27.870417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecd0b0-ac51-47a4-bf6b-4baa293aeb18 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:27.975696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecd0b0-ac51-47a4-bf6b-4baa293aeb18 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:28.018915 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea45f45-d5f9-4119-a70a-e8ac202edbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:28.019974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea45f45-d5f9-4119-a70a-e8ac202edbfc None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:28.020446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea45f45-d5f9-4119-a70a-e8ac202edbfc None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:28.020775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea45f45-d5f9-4119-a70a-e8ac202edbfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:28.033884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea45f45-d5f9-4119-a70a-e8ac202edbfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:28:28.041245 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-8ea45f45-d5f9-4119-a70a-e8ac202edbfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:28:28.043081 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 612/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Feb 28 10:28:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:28:28.050568 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df630c-b14b-489d-a5fc-f3a00f370eb3 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:28.169680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df630c-b14b-489d-a5fc-f3a00f370eb3 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:28.208457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b23d3c-a53b-45a7-a079-0a568e615b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:28.209106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b23d3c-a53b-45a7-a079-0a568e615b9c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:28.209400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b23d3c-a53b-45a7-a079-0a568e615b9c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:28.209675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b23d3c-a53b-45a7-a079-0a568e615b9c None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:28.210411 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b23d3c-a53b-45a7-a079-0a568e615b9c None admin] RBAC: Adding query filter params (name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:28.210709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b23d3c-a53b-45a7-a079-0a568e615b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:28.212075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b23d3c-a53b-45a7-a079-0a568e615b9c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:28.220795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 624/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Feb 28 10:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:28.227129 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea45f45-d5f9-4119-a70a-e8ac202edbfc None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:28.331575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea45f45-d5f9-4119-a70a-e8ac202edbfc None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:28.367985 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c7409-edf3-4428-93a9-e3e692a84189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:28.368886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c7409-edf3-4428-93a9-e3e692a84189 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:28.369229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c7409-edf3-4428-93a9-e3e692a84189 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:28.369513 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c7409-edf3-4428-93a9-e3e692a84189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:28.380682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c7409-edf3-4428-93a9-e3e692a84189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:28.382115 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c7409-edf3-4428-93a9-e3e692a84189 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:28.398709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e71c7409-edf3-4428-93a9-e3e692a84189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:28.399905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 613/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:28:28.406052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b23d3c-a53b-45a7-a079-0a568e615b9c None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:28.524746 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b23d3c-a53b-45a7-a079-0a568e615b9c None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:28.562337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f46aed-1406-4a39-b4b1-f731ccf9c8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:28.563101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46aed-1406-4a39-b4b1-f731ccf9c8e3 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:28.563384 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46aed-1406-4a39-b4b1-f731ccf9c8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:28.563660 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46aed-1406-4a39-b4b1-f731ccf9c8e3 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:28.564463 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f46aed-1406-4a39-b4b1-f731ccf9c8e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:28.564772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f46aed-1406-4a39-b4b1-f731ccf9c8e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:28.566378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f46aed-1406-4a39-b4b1-f731ccf9c8e3 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:28.578754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 625/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:28.588043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c7409-edf3-4428-93a9-e3e692a84189 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:28.696837 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c7409-edf3-4428-93a9-e3e692a84189 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:28.733979 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754698f-519f-4d1b-a509-7dbb1ae47d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:28.734762 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754698f-519f-4d1b-a509-7dbb1ae47d30 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:28.735068 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754698f-519f-4d1b-a509-7dbb1ae47d30 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:28.735333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754698f-519f-4d1b-a509-7dbb1ae47d30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:28.742702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754698f-519f-4d1b-a509-7dbb1ae47d30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:28.744156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754698f-519f-4d1b-a509-7dbb1ae47d30 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:28.758928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e754698f-519f-4d1b-a509-7dbb1ae47d30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:28:28.760286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 614/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:28.767438 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f46aed-1406-4a39-b4b1-f731ccf9c8e3 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:28.874579 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f46aed-1406-4a39-b4b1-f731ccf9c8e3 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:28.910544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1b977-c240-4982-8c9e-b8db063a36c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:28.911304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1b977-c240-4982-8c9e-b8db063a36c6 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:28.911592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1b977-c240-4982-8c9e-b8db063a36c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:28.911902 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1b977-c240-4982-8c9e-b8db063a36c6 None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:28.912919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1b977-c240-4982-8c9e-b8db063a36c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:28.913237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1b977-c240-4982-8c9e-b8db063a36c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:28.914863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1b977-c240-4982-8c9e-b8db063a36c6 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:28.933280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 626/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Feb 28 10:28:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:28.939083 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754698f-519f-4d1b-a509-7dbb1ae47d30 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:29.050743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754698f-519f-4d1b-a509-7dbb1ae47d30 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:29.088294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe6f05-6eec-4c8b-998f-d1ef49e6d13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:29.088966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6f05-6eec-4c8b-998f-d1ef49e6d13e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:29.089277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6f05-6eec-4c8b-998f-d1ef49e6d13e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:29.089604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6f05-6eec-4c8b-998f-d1ef49e6d13e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:29.161889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe6f05-6eec-4c8b-998f-d1ef49e6d13e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:29.163304 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe6f05-6eec-4c8b-998f-d1ef49e6d13e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:29.269124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 615/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:28:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 10:28:29.275348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1b977-c240-4982-8c9e-b8db063a36c6 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:29.396217 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1b977-c240-4982-8c9e-b8db063a36c6 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:29.432099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7295355-0017-401c-8cf1-4cf355e5cab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:29.433434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295355-0017-401c-8cf1-4cf355e5cab9 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:29.433787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295355-0017-401c-8cf1-4cf355e5cab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:29.434127 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295355-0017-401c-8cf1-4cf355e5cab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:29.444679 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7295355-0017-401c-8cf1-4cf355e5cab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:29.446324 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7295355-0017-401c-8cf1-4cf355e5cab9 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:29.463908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-e7295355-0017-401c-8cf1-4cf355e5cab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:29.465142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 627/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:29.471412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe6f05-6eec-4c8b-998f-d1ef49e6d13e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:29.580920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe6f05-6eec-4c8b-998f-d1ef49e6d13e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:29.617079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc30d6-b014-42e1-8f6f-660050209c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:29.617747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc30d6-b014-42e1-8f6f-660050209c81 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:29.618041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc30d6-b014-42e1-8f6f-660050209c81 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:29.618326 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc30d6-b014-42e1-8f6f-660050209c81 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:29.619230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc30d6-b014-42e1-8f6f-660050209c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:29.619581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc30d6-b014-42e1-8f6f-660050209c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:29.621700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc30d6-b014-42e1-8f6f-660050209c81 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:29.633747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 616/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:28:29.639897 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7295355-0017-401c-8cf1-4cf355e5cab9 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:29.743868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7295355-0017-401c-8cf1-4cf355e5cab9 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:29.785118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88cb7e-28b1-4614-ad0d-9edefe00f4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:29.785938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88cb7e-28b1-4614-ad0d-9edefe00f4f3 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:29.786170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88cb7e-28b1-4614-ad0d-9edefe00f4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:29.786439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88cb7e-28b1-4614-ad0d-9edefe00f4f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:29.793394 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88cb7e-28b1-4614-ad0d-9edefe00f4f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:29.794855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88cb7e-28b1-4614-ad0d-9edefe00f4f3 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:29.808181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-2c88cb7e-28b1-4614-ad0d-9edefe00f4f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:28:29.809355 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 628/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:28:29.816027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc30d6-b014-42e1-8f6f-660050209c81 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:29.927812 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc30d6-b014-42e1-8f6f-660050209c81 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:29.966802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922bf29-438c-4464-9368-53fd49c4e1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:29.967499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922bf29-438c-4464-9368-53fd49c4e1b8 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:29.967779 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922bf29-438c-4464-9368-53fd49c4e1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:29.968059 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922bf29-438c-4464-9368-53fd49c4e1b8 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:29.968834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922bf29-438c-4464-9368-53fd49c4e1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:29.969141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922bf29-438c-4464-9368-53fd49c4e1b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:29.970575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922bf29-438c-4464-9368-53fd49c4e1b8 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:29.984909 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 617/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:28:29.991797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88cb7e-28b1-4614-ad0d-9edefe00f4f3 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:30.104103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88cb7e-28b1-4614-ad0d-9edefe00f4f3 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:30.139366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f16cb-0e12-47c3-9415-81d2966c086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:30.140009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f16cb-0e12-47c3-9415-81d2966c086b None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:30.140283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f16cb-0e12-47c3-9415-81d2966c086b None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:30.140548 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f16cb-0e12-47c3-9415-81d2966c086b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:30.141380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f16cb-0e12-47c3-9415-81d2966c086b None admin] RBAC: Adding query filter params (role.id=19a2df51b7b646478ee4f4f466082cab, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=ee30c8013ebb40a99d1eac7820d7f1f8) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:30.141709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f16cb-0e12-47c3-9415-81d2966c086b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:30.143237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f16cb-0e12-47c3-9415-81d2966c086b None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:30.148988 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 629/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:28:29 2022] GET /identity/v3/role_assignments?user.id=ee30c8013ebb40a99d1eac7820d7f1f8&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=19a2df51b7b646478ee4f4f466082cab => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:28:32.800316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99c772-e83e-463e-87d8-0f5e52803781 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:32.800866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99c772-e83e-463e-87d8-0f5e52803781 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:32.800866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99c772-e83e-463e-87d8-0f5e52803781 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:32.802683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 618/1247] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:28:32.809250 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffd727-03ae-4142-8a12-bbc51593608d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:32.809789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffd727-03ae-4142-8a12-bbc51593608d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:32.809789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffd727-03ae-4142-8a12-bbc51593608d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:32.827624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e6ffd727-03ae-4142-8a12-bbc51593608d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:28:32.828844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e6ffd727-03ae-4142-8a12-bbc51593608d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:28:32.896486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 630/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:28:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:28:32.920694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99c772-e83e-463e-87d8-0f5e52803781 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:33.029040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99c772-e83e-463e-87d8-0f5e52803781 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:33.069792 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f75c5-7e27-4cd8-93ca-a70249c23737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:33.070505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f75c5-7e27-4cd8-93ca-a70249c23737 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:33.070775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f75c5-7e27-4cd8-93ca-a70249c23737 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:33.071069 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f75c5-7e27-4cd8-93ca-a70249c23737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:33.081152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f75c5-7e27-4cd8-93ca-a70249c23737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:28:33.087957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-818f75c5-7e27-4cd8-93ca-a70249c23737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:28:33.089352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 619/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:33.095494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffd727-03ae-4142-8a12-bbc51593608d None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:33.192030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffd727-03ae-4142-8a12-bbc51593608d None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:33.223941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a87fe-558b-411c-ae46-959d8813d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:33.224588 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a87fe-558b-411c-ae46-959d8813d5ed None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:33.224864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a87fe-558b-411c-ae46-959d8813d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:33.225131 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a87fe-558b-411c-ae46-959d8813d5ed None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:33.225858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a87fe-558b-411c-ae46-959d8813d5ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:33.226156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a87fe-558b-411c-ae46-959d8813d5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:33.227536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a87fe-558b-411c-ae46-959d8813d5ed None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:33.235686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 631/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:33.241277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f75c5-7e27-4cd8-93ca-a70249c23737 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:33.334287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f75c5-7e27-4cd8-93ca-a70249c23737 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:33.366070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f379eda-9a4b-4531-8c9c-4252ee3677b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:33.366837 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379eda-9a4b-4531-8c9c-4252ee3677b1 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:33.367149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379eda-9a4b-4531-8c9c-4252ee3677b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:33.367416 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379eda-9a4b-4531-8c9c-4252ee3677b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:33.377356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f379eda-9a4b-4531-8c9c-4252ee3677b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:33.378774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f379eda-9a4b-4531-8c9c-4252ee3677b1 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:33.394318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-9f379eda-9a4b-4531-8c9c-4252ee3677b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:33.395470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 620/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:33.401659 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a87fe-558b-411c-ae46-959d8813d5ed None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:33.496260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a87fe-558b-411c-ae46-959d8813d5ed None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:33.528075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77020f1-4768-48b1-8d5a-739673368d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:33.528712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77020f1-4768-48b1-8d5a-739673368d4a None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:33.528996 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77020f1-4768-48b1-8d5a-739673368d4a None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:33.529271 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77020f1-4768-48b1-8d5a-739673368d4a None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:33.529971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77020f1-4768-48b1-8d5a-739673368d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:33.530278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77020f1-4768-48b1-8d5a-739673368d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:33.531643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77020f1-4768-48b1-8d5a-739673368d4a None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:33.543449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 632/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:33.548923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f379eda-9a4b-4531-8c9c-4252ee3677b1 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:33.641369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f379eda-9a4b-4531-8c9c-4252ee3677b1 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:33.672712 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a214e-bd18-4740-87db-dee3ad3c7e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:33.673476 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a214e-bd18-4740-87db-dee3ad3c7e3c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:33.673746 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a214e-bd18-4740-87db-dee3ad3c7e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:33.674009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a214e-bd18-4740-87db-dee3ad3c7e3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:33.680966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a214e-bd18-4740-87db-dee3ad3c7e3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:33.682367 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a214e-bd18-4740-87db-dee3ad3c7e3c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:33.695053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-021a214e-bd18-4740-87db-dee3ad3c7e3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:28:33.696157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 621/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:33.702186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77020f1-4768-48b1-8d5a-739673368d4a None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:33.795782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77020f1-4768-48b1-8d5a-739673368d4a None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:33.829937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaafa5-41d9-4eee-9e03-ca854165179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:33.829937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaafa5-41d9-4eee-9e03-ca854165179e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:33.829937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaafa5-41d9-4eee-9e03-ca854165179e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:33.830802 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaafa5-41d9-4eee-9e03-ca854165179e None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:33.831608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edaafa5-41d9-4eee-9e03-ca854165179e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:33.832129 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edaafa5-41d9-4eee-9e03-ca854165179e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:33.834563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edaafa5-41d9-4eee-9e03-ca854165179e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:33.854495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 633/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Feb 28 10:28:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:33.860469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a214e-bd18-4740-87db-dee3ad3c7e3c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:33.966523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a214e-bd18-4740-87db-dee3ad3c7e3c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:34.006746 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ab33-26b7-4b06-b3dc-dca7e316e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:34.007445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ab33-26b7-4b06-b3dc-dca7e316e181 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:34.007754 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ab33-26b7-4b06-b3dc-dca7e316e181 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:34.008028 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ab33-26b7-4b06-b3dc-dca7e316e181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:34.086667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0ab33-26b7-4b06-b3dc-dca7e316e181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:34.088229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0ab33-26b7-4b06-b3dc-dca7e316e181 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:34.184201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 622/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:28:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:28:34.189915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaafa5-41d9-4eee-9e03-ca854165179e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:34.289392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaafa5-41d9-4eee-9e03-ca854165179e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:34.325104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce597a8-7ea7-401f-a70c-2fe0e69d0b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:34.326379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce597a8-7ea7-401f-a70c-2fe0e69d0b53 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:34.326844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce597a8-7ea7-401f-a70c-2fe0e69d0b53 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:34.327339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce597a8-7ea7-401f-a70c-2fe0e69d0b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:34.343080 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce597a8-7ea7-401f-a70c-2fe0e69d0b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:34.345366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce597a8-7ea7-401f-a70c-2fe0e69d0b53 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:34.364713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-8ce597a8-7ea7-401f-a70c-2fe0e69d0b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:34.365924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 634/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:34.372090 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ab33-26b7-4b06-b3dc-dca7e316e181 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:34.470572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ab33-26b7-4b06-b3dc-dca7e316e181 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:34.503884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda7898-d775-4411-8098-80fc79019641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:34.504539 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda7898-d775-4411-8098-80fc79019641 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:34.504825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda7898-d775-4411-8098-80fc79019641 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:34.505088 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda7898-d775-4411-8098-80fc79019641 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:34.505795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda7898-d775-4411-8098-80fc79019641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:34.506095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda7898-d775-4411-8098-80fc79019641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:34.507496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda7898-d775-4411-8098-80fc79019641 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:34.519291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 623/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:34.524911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce597a8-7ea7-401f-a70c-2fe0e69d0b53 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:34.618760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce597a8-7ea7-401f-a70c-2fe0e69d0b53 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:34.651098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b51773-f9c6-4c4b-9b5e-0d2aee075f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:34.651862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b51773-f9c6-4c4b-9b5e-0d2aee075f4e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:34.652143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b51773-f9c6-4c4b-9b5e-0d2aee075f4e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:34.652409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b51773-f9c6-4c4b-9b5e-0d2aee075f4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:34.658859 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b51773-f9c6-4c4b-9b5e-0d2aee075f4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:34.660292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b51773-f9c6-4c4b-9b5e-0d2aee075f4e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:34.673361 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-51b51773-f9c6-4c4b-9b5e-0d2aee075f4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:28:34.674505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 635/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:28:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:34.680324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda7898-d775-4411-8098-80fc79019641 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:34.777064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda7898-d775-4411-8098-80fc79019641 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:34.807956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb45942-b096-48ad-8ae6-0d0e5164ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:34.808593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb45942-b096-48ad-8ae6-0d0e5164ddb3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:34.808866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb45942-b096-48ad-8ae6-0d0e5164ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:34.809130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb45942-b096-48ad-8ae6-0d0e5164ddb3 None admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:34.810021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb45942-b096-48ad-8ae6-0d0e5164ddb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:34.810327 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb45942-b096-48ad-8ae6-0d0e5164ddb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:34.811770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb45942-b096-48ad-8ae6-0d0e5164ddb3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:34.823907 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 624/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:28:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:28:34.830070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b51773-f9c6-4c4b-9b5e-0d2aee075f4e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:34.929503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b51773-f9c6-4c4b-9b5e-0d2aee075f4e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:34.967241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25016a7e-6ab7-4f2e-b026-f37a887f6dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:34.968254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016a7e-6ab7-4f2e-b026-f37a887f6dfe None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:34.968689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016a7e-6ab7-4f2e-b026-f37a887f6dfe None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:34.969123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016a7e-6ab7-4f2e-b026-f37a887f6dfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:34.970511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25016a7e-6ab7-4f2e-b026-f37a887f6dfe None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=ee30c8013ebb40a99d1eac7820d7f1f8) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:34.971068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25016a7e-6ab7-4f2e-b026-f37a887f6dfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:34.973567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25016a7e-6ab7-4f2e-b026-f37a887f6dfe None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:34.981769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 636/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:28:34 2022] GET /identity/v3/role_assignments?user.id=ee30c8013ebb40a99d1eac7820d7f1f8&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:37.336726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95658f1-c99a-436e-9c8c-cc11e291b0f3 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:37.337222 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95658f1-c99a-436e-9c8c-cc11e291b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:37.337222 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95658f1-c99a-436e-9c8c-cc11e291b0f3 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:37.339707 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 625/1261] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:28:37.344901 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689903b4-051c-4134-b7e3-be7bba00e103 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:37.345309 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689903b4-051c-4134-b7e3-be7bba00e103 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:37.345454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689903b4-051c-4134-b7e3-be7bba00e103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:37.362749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-689903b4-051c-4134-b7e3-be7bba00e103 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:28:37.363944 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-689903b4-051c-4134-b7e3-be7bba00e103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:28:37.430986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 637/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:28:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:28:37.454231 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95658f1-c99a-436e-9c8c-cc11e291b0f3 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:37.549942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95658f1-c99a-436e-9c8c-cc11e291b0f3 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:37.581422 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ed679-98f0-477c-9bd2-ff48fc78ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:37.582185 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ed679-98f0-477c-9bd2-ff48fc78ce2e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:37.582460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ed679-98f0-477c-9bd2-ff48fc78ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:37.582729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ed679-98f0-477c-9bd2-ff48fc78ce2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:37.592844 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ed679-98f0-477c-9bd2-ff48fc78ce2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:28:37.599497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-7d0ed679-98f0-477c-9bd2-ff48fc78ce2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:28:37.600643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 626/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:28:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:37.606544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689903b4-051c-4134-b7e3-be7bba00e103 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:37.698824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689903b4-051c-4134-b7e3-be7bba00e103 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:37.730516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a8bd4-a491-427f-adff-307cfa3099eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:37.731192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a8bd4-a491-427f-adff-307cfa3099eb None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:37.731473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a8bd4-a491-427f-adff-307cfa3099eb None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:37.731743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a8bd4-a491-427f-adff-307cfa3099eb None admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:37.732479 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a8bd4-a491-427f-adff-307cfa3099eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:37.732781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a8bd4-a491-427f-adff-307cfa3099eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:37.734125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a8bd4-a491-427f-adff-307cfa3099eb None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:37.741691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 638/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:28:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:37.747239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ed679-98f0-477c-9bd2-ff48fc78ce2e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:37.841080 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ed679-98f0-477c-9bd2-ff48fc78ce2e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:37.872176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c27a26-d5b2-46fb-bd9a-8959ce6e30bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:37.872928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c27a26-d5b2-46fb-bd9a-8959ce6e30bd None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:37.873202 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c27a26-d5b2-46fb-bd9a-8959ce6e30bd None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:37.873471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c27a26-d5b2-46fb-bd9a-8959ce6e30bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:37.883257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c27a26-d5b2-46fb-bd9a-8959ce6e30bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:37.884929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c27a26-d5b2-46fb-bd9a-8959ce6e30bd None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:37.900729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-12c27a26-d5b2-46fb-bd9a-8959ce6e30bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:37.901841 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 627/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:37.907325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a8bd4-a491-427f-adff-307cfa3099eb None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:38.003210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a8bd4-a491-427f-adff-307cfa3099eb None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:38.041013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730d7c3-f51f-4296-8322-cc98d7d0e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:38.041736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730d7c3-f51f-4296-8322-cc98d7d0e590 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:38.042058 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730d7c3-f51f-4296-8322-cc98d7d0e590 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:38.042359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730d7c3-f51f-4296-8322-cc98d7d0e590 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:38.043227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730d7c3-f51f-4296-8322-cc98d7d0e590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:38.043487 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730d7c3-f51f-4296-8322-cc98d7d0e590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:38.045026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730d7c3-f51f-4296-8322-cc98d7d0e590 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:38.059095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 639/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:38.065694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c27a26-d5b2-46fb-bd9a-8959ce6e30bd None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:38.164212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c27a26-d5b2-46fb-bd9a-8959ce6e30bd None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:38.195638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74686d-92ab-4976-8c1e-2edf67a1d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:38.196420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74686d-92ab-4976-8c1e-2edf67a1d347 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:38.196696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74686d-92ab-4976-8c1e-2edf67a1d347 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:38.196964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74686d-92ab-4976-8c1e-2edf67a1d347 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:38.204623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74686d-92ab-4976-8c1e-2edf67a1d347 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:38.206050 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74686d-92ab-4976-8c1e-2edf67a1d347 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:38.218854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-4f74686d-92ab-4976-8c1e-2edf67a1d347 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:28:38.220017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 628/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:38.225750 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730d7c3-f51f-4296-8322-cc98d7d0e590 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:38.319600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730d7c3-f51f-4296-8322-cc98d7d0e590 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:38.351049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ddfac-404a-4db5-9e5b-5f5d1327bf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:38.351700 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ddfac-404a-4db5-9e5b-5f5d1327bf8f None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:38.351950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ddfac-404a-4db5-9e5b-5f5d1327bf8f None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:38.352218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ddfac-404a-4db5-9e5b-5f5d1327bf8f None admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:38.353087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ddfac-404a-4db5-9e5b-5f5d1327bf8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:38.353391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ddfac-404a-4db5-9e5b-5f5d1327bf8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:38.355349 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ddfac-404a-4db5-9e5b-5f5d1327bf8f None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:38.372074 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 640/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Feb 28 10:28:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:38.377394 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74686d-92ab-4976-8c1e-2edf67a1d347 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:38.470428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74686d-92ab-4976-8c1e-2edf67a1d347 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:38.502300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b445-6bc2-4cd1-b82d-5391a626f5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:38.503092 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b445-6bc2-4cd1-b82d-5391a626f5c4 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:38.503371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b445-6bc2-4cd1-b82d-5391a626f5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:38.503642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b445-6bc2-4cd1-b82d-5391a626f5c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:38.513716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b445-6bc2-4cd1-b82d-5391a626f5c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:38.515153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b445-6bc2-4cd1-b82d-5391a626f5c4 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:38.530462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-e217b445-6bc2-4cd1-b82d-5391a626f5c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:38.531612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 629/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:38.537358 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ddfac-404a-4db5-9e5b-5f5d1327bf8f None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:38.629283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ddfac-404a-4db5-9e5b-5f5d1327bf8f None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:38.660785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a63e2-ed51-4fb7-abbf-836f8f277c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:38.661415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a63e2-ed51-4fb7-abbf-836f8f277c58 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:38.661690 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a63e2-ed51-4fb7-abbf-836f8f277c58 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:38.661959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a63e2-ed51-4fb7-abbf-836f8f277c58 None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:38.662654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a63e2-ed51-4fb7-abbf-836f8f277c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:38.662979 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a63e2-ed51-4fb7-abbf-836f8f277c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:38.664311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a63e2-ed51-4fb7-abbf-836f8f277c58 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:38.674788 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 641/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:38.680099 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b445-6bc2-4cd1-b82d-5391a626f5c4 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:38.772725 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b445-6bc2-4cd1-b82d-5391a626f5c4 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:38.802874 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d909514-153d-4b56-93b4-3eef89ead0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:38.803649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909514-153d-4b56-93b4-3eef89ead0f3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:38.803921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909514-153d-4b56-93b4-3eef89ead0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:38.804183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909514-153d-4b56-93b4-3eef89ead0f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:38.810945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d909514-153d-4b56-93b4-3eef89ead0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:38.812352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d909514-153d-4b56-93b4-3eef89ead0f3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:38.828117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-1d909514-153d-4b56-93b4-3eef89ead0f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:28:38.829233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 630/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:38.834893 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a63e2-ed51-4fb7-abbf-836f8f277c58 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:38.927269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a63e2-ed51-4fb7-abbf-836f8f277c58 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:38.959617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05d8a2-f129-4276-9ad0-2cdffe003fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:38.960254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05d8a2-f129-4276-9ad0-2cdffe003fec None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:38.960536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05d8a2-f129-4276-9ad0-2cdffe003fec None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:38.960812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05d8a2-f129-4276-9ad0-2cdffe003fec None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:38.961581 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05d8a2-f129-4276-9ad0-2cdffe003fec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:38.961887 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05d8a2-f129-4276-9ad0-2cdffe003fec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:38.963326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05d8a2-f129-4276-9ad0-2cdffe003fec None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:38.974609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 642/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:38.980723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d909514-153d-4b56-93b4-3eef89ead0f3 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:39.074642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d909514-153d-4b56-93b4-3eef89ead0f3 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:39.107372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042efcc1-7554-416f-a130-b526be1582bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:39.108249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042efcc1-7554-416f-a130-b526be1582bf None admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:39.108524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042efcc1-7554-416f-a130-b526be1582bf None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:39.108793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042efcc1-7554-416f-a130-b526be1582bf None admin] PATH_INFO: `/v3/projects/da6b83a381114e5eb99dd77e01292829/users/ee30c8013ebb40a99d1eac7820d7f1f8/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:39.110717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042efcc1-7554-416f-a130-b526be1582bf None admin] RBAC: Authorizing `identity:create_grant(project_id=da6b83a381114e5eb99dd77e01292829, user_id=ee30c8013ebb40a99d1eac7820d7f1f8, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:39.112200 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042efcc1-7554-416f-a130-b526be1582bf None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:39.125264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 631/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Feb 28 10:28:38 2022] PUT /identity/v3/projects/da6b83a381114e5eb99dd77e01292829/users/ee30c8013ebb40a99d1eac7820d7f1f8/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:28:41.585642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a831b-9935-44c9-b464-d54e38b059d2 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:41.586200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a831b-9935-44c9-b464-d54e38b059d2 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:41.586200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a831b-9935-44c9-b464-d54e38b059d2 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:41.588497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 643/1274] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:28:41.593794 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc628a-8c8d-4fe3-a58a-bd0ad2695257 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:41.594196 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc628a-8c8d-4fe3-a58a-bd0ad2695257 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:41.594344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc628a-8c8d-4fe3-a58a-bd0ad2695257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:41.611266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-11cc628a-8c8d-4fe3-a58a-bd0ad2695257 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:28:41.612436 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-11cc628a-8c8d-4fe3-a58a-bd0ad2695257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:28:41.674971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 632/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:28:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:28:41.697767 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a831b-9935-44c9-b464-d54e38b059d2 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:41.794718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a831b-9935-44c9-b464-d54e38b059d2 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:41.825226 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b01bce-a659-4f68-974d-8c72b8703832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:41.825980 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01bce-a659-4f68-974d-8c72b8703832 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:41.826258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01bce-a659-4f68-974d-8c72b8703832 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:41.826528 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01bce-a659-4f68-974d-8c72b8703832 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:41.836553 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b01bce-a659-4f68-974d-8c72b8703832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:28:41.843743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-83b01bce-a659-4f68-974d-8c72b8703832 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:28:41.844880 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 644/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Feb 28 10:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:41.850824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc628a-8c8d-4fe3-a58a-bd0ad2695257 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:41.943306 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc628a-8c8d-4fe3-a58a-bd0ad2695257 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:41.975284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580efa20-acdf-4019-a7d1-dce2c4a6ba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:41.975927 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580efa20-acdf-4019-a7d1-dce2c4a6ba53 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:41.976199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580efa20-acdf-4019-a7d1-dce2c4a6ba53 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:41.976464 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580efa20-acdf-4019-a7d1-dce2c4a6ba53 None admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:41.977183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580efa20-acdf-4019-a7d1-dce2c4a6ba53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:41.977481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580efa20-acdf-4019-a7d1-dce2c4a6ba53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:41.978871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580efa20-acdf-4019-a7d1-dce2c4a6ba53 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:41.986410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 633/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Feb 28 10:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:41.993363 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b01bce-a659-4f68-974d-8c72b8703832 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:42.096378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b01bce-a659-4f68-974d-8c72b8703832 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:42.127482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefff0e-58e6-463e-a861-eb701d7858cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:42.128252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefff0e-58e6-463e-a861-eb701d7858cc None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:42.128528 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefff0e-58e6-463e-a861-eb701d7858cc None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:42.128798 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefff0e-58e6-463e-a861-eb701d7858cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:42.139025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefff0e-58e6-463e-a861-eb701d7858cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:42.140436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefff0e-58e6-463e-a861-eb701d7858cc None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:42.156888 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-3aefff0e-58e6-463e-a861-eb701d7858cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:42.158029 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 645/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:42.163844 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580efa20-acdf-4019-a7d1-dce2c4a6ba53 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:42.256479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580efa20-acdf-4019-a7d1-dce2c4a6ba53 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:42.288472 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23efac7-6863-46ef-8670-0f4a36c85bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:42.289114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23efac7-6863-46ef-8670-0f4a36c85bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:42.289393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23efac7-6863-46ef-8670-0f4a36c85bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:42.289663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23efac7-6863-46ef-8670-0f4a36c85bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:42.290360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23efac7-6863-46ef-8670-0f4a36c85bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:42.290661 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23efac7-6863-46ef-8670-0f4a36c85bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:42.292071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23efac7-6863-46ef-8670-0f4a36c85bf3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:42.303049 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 634/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:42.308438 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefff0e-58e6-463e-a861-eb701d7858cc None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:42.401941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefff0e-58e6-463e-a861-eb701d7858cc None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:42.432970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7efbc-1588-40f9-9a05-89830a27c06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:42.433729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7efbc-1588-40f9-9a05-89830a27c06e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:42.434009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7efbc-1588-40f9-9a05-89830a27c06e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:42.434282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7efbc-1588-40f9-9a05-89830a27c06e None admin] PATH_INFO: `/v3/users/placement` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:42.441319 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7efbc-1588-40f9-9a05-89830a27c06e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:42.442726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7efbc-1588-40f9-9a05-89830a27c06e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:42.456236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-7fa7efbc-1588-40f9-9a05-89830a27c06e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:28:42.457342 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 646/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:42.462953 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23efac7-6863-46ef-8670-0f4a36c85bf3 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:42.556303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23efac7-6863-46ef-8670-0f4a36c85bf3 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:42.587511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dff682-3121-4c5a-8270-bd23b94c956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:42.588649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dff682-3121-4c5a-8270-bd23b94c956c None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:42.588929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dff682-3121-4c5a-8270-bd23b94c956c None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:42.589201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dff682-3121-4c5a-8270-bd23b94c956c None admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:42.590012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dff682-3121-4c5a-8270-bd23b94c956c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:42.590314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dff682-3121-4c5a-8270-bd23b94c956c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:42.591741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dff682-3121-4c5a-8270-bd23b94c956c None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:42.608433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 635/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Feb 28 10:28:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:42.613840 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7efbc-1588-40f9-9a05-89830a27c06e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:42.707263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7efbc-1588-40f9-9a05-89830a27c06e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:42.738564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e30de-1a38-4515-9272-a67204e7c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:42.739201 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e30de-1a38-4515-9272-a67204e7c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:42.739478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e30de-1a38-4515-9272-a67204e7c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:42.739749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e30de-1a38-4515-9272-a67204e7c6e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:42.801831 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e30de-1a38-4515-9272-a67204e7c6e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:42.803263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e30de-1a38-4515-9272-a67204e7c6e0 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:42.895181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 647/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Feb 28 10:28:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:28:42.900845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dff682-3121-4c5a-8270-bd23b94c956c None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:42.994847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dff682-3121-4c5a-8270-bd23b94c956c None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:43.027714 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae359be-30d8-4c4c-8e8a-b00de26f4498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:43.028489 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae359be-30d8-4c4c-8e8a-b00de26f4498 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:43.028766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae359be-30d8-4c4c-8e8a-b00de26f4498 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:43.029037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae359be-30d8-4c4c-8e8a-b00de26f4498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:43.038393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae359be-30d8-4c4c-8e8a-b00de26f4498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:43.039850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae359be-30d8-4c4c-8e8a-b00de26f4498 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:43.056148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-3ae359be-30d8-4c4c-8e8a-b00de26f4498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:28:43.057889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 636/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:43.063586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e30de-1a38-4515-9272-a67204e7c6e0 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:43.155068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e30de-1a38-4515-9272-a67204e7c6e0 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:43.186423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00531367-02af-4554-833b-0621e462cfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:43.187083 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00531367-02af-4554-833b-0621e462cfdf None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:43.187358 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00531367-02af-4554-833b-0621e462cfdf None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:43.187626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00531367-02af-4554-833b-0621e462cfdf None admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:43.188323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00531367-02af-4554-833b-0621e462cfdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:43.188621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00531367-02af-4554-833b-0621e462cfdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:43.189957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00531367-02af-4554-833b-0621e462cfdf None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:43.200619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 648/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Feb 28 10:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:43.206144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae359be-30d8-4c4c-8e8a-b00de26f4498 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:43.310324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae359be-30d8-4c4c-8e8a-b00de26f4498 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:43.342344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bacd7c-4743-4dc4-bf32-29782c76a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:43.343138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bacd7c-4743-4dc4-bf32-29782c76a162 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:43.343412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bacd7c-4743-4dc4-bf32-29782c76a162 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:43.343676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bacd7c-4743-4dc4-bf32-29782c76a162 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:43.349845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bacd7c-4743-4dc4-bf32-29782c76a162 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:43.351296 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bacd7c-4743-4dc4-bf32-29782c76a162 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:43.364342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING keystone.server.flask.application [None req-68bacd7c-4743-4dc4-bf32-29782c76a162 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:28:43.365466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 637/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Feb 28 10:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:43.372485 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00531367-02af-4554-833b-0621e462cfdf None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:43.466788 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00531367-02af-4554-833b-0621e462cfdf None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:43.497646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9a0e2-6fec-409d-8ddb-ca7f48010189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:43.498291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a0e2-6fec-409d-8ddb-ca7f48010189 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:43.498578 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a0e2-6fec-409d-8ddb-ca7f48010189 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:43.498856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a0e2-6fec-409d-8ddb-ca7f48010189 None admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:43.499659 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9a0e2-6fec-409d-8ddb-ca7f48010189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:43.499965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9a0e2-6fec-409d-8ddb-ca7f48010189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:43.501374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9a0e2-6fec-409d-8ddb-ca7f48010189 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:43.513430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 649/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Feb 28 10:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:28:43.519455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bacd7c-4743-4dc4-bf32-29782c76a162 None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:43.612119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bacd7c-4743-4dc4-bf32-29782c76a162 None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:43.647101 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20447f-d36a-4a41-b936-ed53b616cb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:43.647734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20447f-d36a-4a41-b936-ed53b616cb11 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:43.648006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20447f-d36a-4a41-b936-ed53b616cb11 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:43.648267 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20447f-d36a-4a41-b936-ed53b616cb11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:43.649068 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20447f-d36a-4a41-b936-ed53b616cb11 None admin] RBAC: Adding query filter params (role.id=c165d9ae44384936842d67d7cafd3f7d, scope.project.id=da6b83a381114e5eb99dd77e01292829, user.id=ee30c8013ebb40a99d1eac7820d7f1f8) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:43.649365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20447f-d36a-4a41-b936-ed53b616cb11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:43.651470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20447f-d36a-4a41-b936-ed53b616cb11 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:43.656986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 638/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Feb 28 10:28:43 2022] GET /identity/v3/role_assignments?user.id=ee30c8013ebb40a99d1eac7820d7f1f8&scope.project.id=da6b83a381114e5eb99dd77e01292829&role.id=c165d9ae44384936842d67d7cafd3f7d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:45.962882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcb211-b38b-41cb-a8e7-d6b54816e16f None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:45.963425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcb211-b38b-41cb-a8e7-d6b54816e16f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:45.963548 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcb211-b38b-41cb-a8e7-d6b54816e16f None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:45.965252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 650/1288] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:28:45.970428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474636-9593-4314-a375-2c43b2f70d8b None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:45.970842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474636-9593-4314-a375-2c43b2f70d8b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:45.970997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474636-9593-4314-a375-2c43b2f70d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:45.987672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a9474636-9593-4314-a375-2c43b2f70d8b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:28:45.988959 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a9474636-9593-4314-a375-2c43b2f70d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:28:46.064544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 639/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:28:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:28:46.088827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcb211-b38b-41cb-a8e7-d6b54816e16f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:46.184007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcb211-b38b-41cb-a8e7-d6b54816e16f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:46.215488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688fd9d-a973-4d26-81fa-f2f6a4eb5342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:46.216207 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688fd9d-a973-4d26-81fa-f2f6a4eb5342 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:46.216484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688fd9d-a973-4d26-81fa-f2f6a4eb5342 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:46.216756 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688fd9d-a973-4d26-81fa-f2f6a4eb5342 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:46.217395 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688fd9d-a973-4d26-81fa-f2f6a4eb5342 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:46.218744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688fd9d-a973-4d26-81fa-f2f6a4eb5342 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:46.229998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-e688fd9d-a973-4d26-81fa-f2f6a4eb5342 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 10:28:46.231152 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 651/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Feb 28 10:28:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:46.236908 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9474636-9593-4314-a375-2c43b2f70d8b None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:46.327747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9474636-9593-4314-a375-2c43b2f70d8b None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:46.359623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37769e2-539e-462a-8dfe-038a50f83e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:46.360253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37769e2-539e-462a-8dfe-038a50f83e9f None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:46.360525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37769e2-539e-462a-8dfe-038a50f83e9f None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:46.360791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37769e2-539e-462a-8dfe-038a50f83e9f None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:46.361471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37769e2-539e-462a-8dfe-038a50f83e9f None admin] RBAC: Adding query filter params (name=placement) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:46.361767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37769e2-539e-462a-8dfe-038a50f83e9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:46.363150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37769e2-539e-462a-8dfe-038a50f83e9f None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:46.368017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 640/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Mon Feb 28 10:28:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:46.373500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688fd9d-a973-4d26-81fa-f2f6a4eb5342 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:46.467167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688fd9d-a973-4d26-81fa-f2f6a4eb5342 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:46.497905 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e33b8-8521-449d-b4b7-c8afaf7ff60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:46.498543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e33b8-8521-449d-b4b7-c8afaf7ff60c None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:46.498822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e33b8-8521-449d-b4b7-c8afaf7ff60c None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:46.499123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e33b8-8521-449d-b4b7-c8afaf7ff60c None admin] PATH_INFO: `/v3/services` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:46.499812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e33b8-8521-449d-b4b7-c8afaf7ff60c None admin] RBAC: Adding query filter params (type=placement) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:46.500113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e33b8-8521-449d-b4b7-c8afaf7ff60c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:46.501454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e33b8-8521-449d-b4b7-c8afaf7ff60c None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:46.505643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 652/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Mon Feb 28 10:28:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:48.779809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493964c9-76bb-4549-9c60-e74069a8590a None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:48.780343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493964c9-76bb-4549-9c60-e74069a8590a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:48.780343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493964c9-76bb-4549-9c60-e74069a8590a None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:48.782116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 641/1293] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:28:48.787142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dabd0-451d-43ad-bf4e-37f4276f94dc None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:48.787558 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dabd0-451d-43ad-bf4e-37f4276f94dc None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:48.787694 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dabd0-451d-43ad-bf4e-37f4276f94dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:48.804304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-968dabd0-451d-43ad-bf4e-37f4276f94dc None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:28:48.805469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-968dabd0-451d-43ad-bf4e-37f4276f94dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:28:48.869895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 653/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:28:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:28:48.893036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493964c9-76bb-4549-9c60-e74069a8590a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:48.989672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493964c9-76bb-4549-9c60-e74069a8590a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:49.028376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74281a2a-fca4-4837-81db-468f45d19fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:49.029047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74281a2a-fca4-4837-81db-468f45d19fb3 None admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:49.029335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74281a2a-fca4-4837-81db-468f45d19fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:49.029631 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74281a2a-fca4-4837-81db-468f45d19fb3 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:49.030419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74281a2a-fca4-4837-81db-468f45d19fb3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:49.031775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74281a2a-fca4-4837-81db-468f45d19fb3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:49.048925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 642/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Feb 28 10:28:48 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:28:51.342933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3ca76-83e4-4ef5-982b-25adda5a0847 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:51.343428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3ca76-83e4-4ef5-982b-25adda5a0847 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:51.343428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3ca76-83e4-4ef5-982b-25adda5a0847 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:51.345183 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 654/1296] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:28:51.350415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25155c45-4b3a-47fb-ba10-289f8e7a91f3 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:51.350825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25155c45-4b3a-47fb-ba10-289f8e7a91f3 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:51.351013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25155c45-4b3a-47fb-ba10-289f8e7a91f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:51.367754 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-25155c45-4b3a-47fb-ba10-289f8e7a91f3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:28:51.368934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-25155c45-4b3a-47fb-ba10-289f8e7a91f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:28:51.437801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 643/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:28:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:28:51.460873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3ca76-83e4-4ef5-982b-25adda5a0847 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:51.571634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3ca76-83e4-4ef5-982b-25adda5a0847 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:51.605796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c769ec-3bb9-44cd-a151-a6da93d9543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:51.606576 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c769ec-3bb9-44cd-a151-a6da93d9543e None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:51.606846 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c769ec-3bb9-44cd-a151-a6da93d9543e None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:51.607143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c769ec-3bb9-44cd-a151-a6da93d9543e None admin] PATH_INFO: `/v3/services/placement` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:51.607784 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c769ec-3bb9-44cd-a151-a6da93d9543e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:51.609133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c769ec-3bb9-44cd-a151-a6da93d9543e None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:51.620634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-09c769ec-3bb9-44cd-a151-a6da93d9543e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 10:28:51.621757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 655/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Feb 28 10:28:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:51.627891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25155c45-4b3a-47fb-ba10-289f8e7a91f3 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:51.719770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25155c45-4b3a-47fb-ba10-289f8e7a91f3 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:51.751718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1c698-ec4e-48d8-8415-db0ddb78444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:51.752353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c698-ec4e-48d8-8415-db0ddb78444e None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:51.752629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c698-ec4e-48d8-8415-db0ddb78444e None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:51.752896 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c698-ec4e-48d8-8415-db0ddb78444e None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:51.753580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1c698-ec4e-48d8-8415-db0ddb78444e None admin] RBAC: Adding query filter params (name=placement) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:51.753878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1c698-ec4e-48d8-8415-db0ddb78444e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:51.755258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1c698-ec4e-48d8-8415-db0ddb78444e None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:51.760892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 644/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Mon Feb 28 10:28:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:28:51.766637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c769ec-3bb9-44cd-a151-a6da93d9543e None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:51.858007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c769ec-3bb9-44cd-a151-a6da93d9543e None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:51.889726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245be65-8f5a-4c8c-9850-b857dd7db358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:51.890339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245be65-8f5a-4c8c-9850-b857dd7db358 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:51.890615 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245be65-8f5a-4c8c-9850-b857dd7db358 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:51.890885 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245be65-8f5a-4c8c-9850-b857dd7db358 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:51.891669 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245be65-8f5a-4c8c-9850-b857dd7db358 None admin] RBAC: Adding query filter params (interface=public, service_id=3ff233fc4ab54d8286ed51424e53c71f, region_id=RegionOne) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:51.891977 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245be65-8f5a-4c8c-9850-b857dd7db358 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:51.893295 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245be65-8f5a-4c8c-9850-b857dd7db358 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:51.897962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 656/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Feb 28 10:28:51 2022] GET /identity/v3/endpoints?service_id=3ff233fc4ab54d8286ed51424e53c71f&interface=public®ion_id=RegionOne => generated 194 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:51.903281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1c698-ec4e-48d8-8415-db0ddb78444e None admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:51.995620 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1c698-ec4e-48d8-8415-db0ddb78444e None admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:52.027456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da2e44-feb5-4eb8-9db6-de7c807aa000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:52.028100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da2e44-feb5-4eb8-9db6-de7c807aa000 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:52.028377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da2e44-feb5-4eb8-9db6-de7c807aa000 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:52.028647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da2e44-feb5-4eb8-9db6-de7c807aa000 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:52.029311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da2e44-feb5-4eb8-9db6-de7c807aa000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:52.030652 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da2e44-feb5-4eb8-9db6-de7c807aa000 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:52.037135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 645/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Feb 28 10:28:51 2022] GET /identity/v3/services => generated 2191 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:28:54.313992 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314b6cf-ad07-470d-8561-8fa2ac91a95e None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:54.314539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314b6cf-ad07-470d-8561-8fa2ac91a95e None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:54.314539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314b6cf-ad07-470d-8561-8fa2ac91a95e None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:54.316509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 657/1302] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:28:54.321602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6de9ec-b6b9-4a37-a045-fda710862fbf None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:54.322584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6de9ec-b6b9-4a37-a045-fda710862fbf None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:54.322837 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6de9ec-b6b9-4a37-a045-fda710862fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:54.339329 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-8d6de9ec-b6b9-4a37-a045-fda710862fbf None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:28:54.340424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-8d6de9ec-b6b9-4a37-a045-fda710862fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:28:54.404987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 646/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:28:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:28:54.428050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314b6cf-ad07-470d-8561-8fa2ac91a95e None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:54.527499 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314b6cf-ad07-470d-8561-8fa2ac91a95e None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:54.558743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdedcbf-6b0a-4b84-a29e-b5f6344f8113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:54.559549 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdedcbf-6b0a-4b84-a29e-b5f6344f8113 None admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:54.559830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdedcbf-6b0a-4b84-a29e-b5f6344f8113 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:54.560102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdedcbf-6b0a-4b84-a29e-b5f6344f8113 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:54.560744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdedcbf-6b0a-4b84-a29e-b5f6344f8113 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:54.562092 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdedcbf-6b0a-4b84-a29e-b5f6344f8113 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:54.573194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING keystone.server.flask.application [None req-8cdedcbf-6b0a-4b84-a29e-b5f6344f8113 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 10:28:54.574338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 658/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Feb 28 10:28:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:28:54.580513 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6de9ec-b6b9-4a37-a045-fda710862fbf None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:54.673038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6de9ec-b6b9-4a37-a045-fda710862fbf None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:54.704912 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b0209-861e-4cf6-a3ec-8273535a63d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:54.705546 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0209-861e-4cf6-a3ec-8273535a63d3 None admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:54.705822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0209-861e-4cf6-a3ec-8273535a63d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:54.706090 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0209-861e-4cf6-a3ec-8273535a63d3 None admin] PATH_INFO: `/v3/services` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:54.706779 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b0209-861e-4cf6-a3ec-8273535a63d3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:28:54.707103 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b0209-861e-4cf6-a3ec-8273535a63d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:54.708451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b0209-861e-4cf6-a3ec-8273535a63d3 None admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:54.713886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 647/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Mon Feb 28 10:28:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:28:54.719382 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdedcbf-6b0a-4b84-a29e-b5f6344f8113 None admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:28:54.811773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdedcbf-6b0a-4b84-a29e-b5f6344f8113 None admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:28:54.845292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d7c99-9505-48b7-8248-7bd1bfad1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:28:54.846181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d7c99-9505-48b7-8248-7bd1bfad1610 None admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:28:54.846462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d7c99-9505-48b7-8248-7bd1bfad1610 None admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:28:54.846736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d7c99-9505-48b7-8248-7bd1bfad1610 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:28:54.847489 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d7c99-9505-48b7-8248-7bd1bfad1610 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:28:54.848830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d7c99-9505-48b7-8248-7bd1bfad1610 None admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:28:54.866211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 659/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Feb 28 10:28:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:29:57.879294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fe550-73e4-4204-891d-fffd182aa6b5 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:57.879868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fe550-73e4-4204-891d-fffd182aa6b5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:57.879868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fe550-73e4-4204-891d-fffd182aa6b5 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:57.881608 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 648/1307] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:29:57.887316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afcf0c-fc91-4e82-9f70-58085aa7bd26 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:57.887778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afcf0c-fc91-4e82-9f70-58085aa7bd26 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:57.887872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afcf0c-fc91-4e82-9f70-58085aa7bd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:58.047270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-a2afcf0c-fc91-4e82-9f70-58085aa7bd26 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:58.048622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a2afcf0c-fc91-4e82-9f70-58085aa7bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:58.282925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 660/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:29:58.301388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fe550-73e4-4204-891d-fffd182aa6b5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:29:58.305685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-170fe550-73e4-4204-891d-fffd182aa6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:58.511145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fe550-73e4-4204-891d-fffd182aa6b5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:29:58.616828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd81d2d-dbda-4b7c-9f33-cd5604c09404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:29:58.617503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81d2d-dbda-4b7c-9f33-cd5604c09404 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:58.617832 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81d2d-dbda-4b7c-9f33-cd5604c09404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:58.618058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81d2d-dbda-4b7c-9f33-cd5604c09404 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:58.618786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd81d2d-dbda-4b7c-9f33-cd5604c09404 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:29:58.620655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING py.warnings [None req-fdd81d2d-dbda-4b7c-9f33-cd5604c09404 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:29:58.620655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: warnings.warn(msg) Feb 28 10:29:58.620655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: Feb 28 10:29:58.621800 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd81d2d-dbda-4b7c-9f33-cd5604c09404 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:29:58.659632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 649/1309] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:29:58 2022] GET /identity/v3/projects => generated 2553 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:30:01.015482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bfe78-a41f-40f4-8e32-16afa0616c5a None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:01.016057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bfe78-a41f-40f4-8e32-16afa0616c5a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:01.016057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bfe78-a41f-40f4-8e32-16afa0616c5a None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:01.017734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 661/1310] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:01.022996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8027ed-6250-4a75-8cb9-5078866aba80 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:01.023455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8027ed-6250-4a75-8cb9-5078866aba80 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:01.023614 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8027ed-6250-4a75-8cb9-5078866aba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:01.091901 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-bc8027ed-6250-4a75-8cb9-5078866aba80 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:01.093095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-bc8027ed-6250-4a75-8cb9-5078866aba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:01.184297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 650/1311] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:01.234598 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9697d-f825-421b-9bbf-4d6e80ad2b32 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:01.235037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9697d-f825-421b-9bbf-4d6e80ad2b32 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:01.235391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9697d-f825-421b-9bbf-4d6e80ad2b32 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:01.237227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 662/1312] 10.222.0.44 () {54 vars in 964 bytes} [Mon Feb 28 10:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:01.243181 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e1d9b-2744-4f34-a3bf-adf5dc01e5bd None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:01.243468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e1d9b-2744-4f34-a3bf-adf5dc01e5bd None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:01.243741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e1d9b-2744-4f34-a3bf-adf5dc01e5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:01.316697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e66e1d9b-2744-4f34-a3bf-adf5dc01e5bd None None] MFA Rules not processed for user `44fb3491570c41cbb7271cfce1c31e39`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:01.317789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e66e1d9b-2744-4f34-a3bf-adf5dc01e5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:01.391554 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 651/1313] 10.222.0.44 () {58 vars in 1061 bytes} [Mon Feb 28 10:30:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:01.401287 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9697d-f825-421b-9bbf-4d6e80ad2b32 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:01.402853 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3ea9697d-f825-421b-9bbf-4d6e80ad2b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:01.525034 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9697d-f825-421b-9bbf-4d6e80ad2b32 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:01.599047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0f43b-4d30-4801-8b7a-cb01b67d54bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:01.599690 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0f43b-4d30-4801-8b7a-cb01b67d54bc service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:01.599965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0f43b-4d30-4801-8b7a-cb01b67d54bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:01.600235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0f43b-4d30-4801-8b7a-cb01b67d54bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:01.602376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-50e0f43b-4d30-4801-8b7a-cb01b67d54bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:01.707213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0f43b-4d30-4801-8b7a-cb01b67d54bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:01.708647 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0f43b-4d30-4801-8b7a-cb01b67d54bc service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:01.726426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 663/1314] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:30:04.293387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82e89-745e-42d8-a3e8-628b6c55d681 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:04.293974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82e89-745e-42d8-a3e8-628b6c55d681 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:04.293974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82e89-745e-42d8-a3e8-628b6c55d681 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:04.295764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 652/1315] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:04.300837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebfcc5-244d-4d99-8b77-1210660ed951 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:04.301366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebfcc5-244d-4d99-8b77-1210660ed951 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:04.301471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebfcc5-244d-4d99-8b77-1210660ed951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:04.364359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-36ebfcc5-244d-4d99-8b77-1210660ed951 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:04.365577 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-36ebfcc5-244d-4d99-8b77-1210660ed951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:04.457818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 664/1316] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:04.495391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe82e89-745e-42d8-a3e8-628b6c55d681 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:04.496891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6fe82e89-745e-42d8-a3e8-628b6c55d681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:04.593959 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe82e89-745e-42d8-a3e8-628b6c55d681 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:04.661419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a467b-348f-484e-8e63-57f2af523c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:04.661981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a467b-348f-484e-8e63-57f2af523c0d service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:04.662255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a467b-348f-484e-8e63-57f2af523c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:04.662519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a467b-348f-484e-8e63-57f2af523c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:04.664644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b93a467b-348f-484e-8e63-57f2af523c0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:04.767104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a467b-348f-484e-8e63-57f2af523c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:04.768530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a467b-348f-484e-8e63-57f2af523c0d service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:04.785650 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 653/1317] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:30:07.351091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a3aaf-586c-4786-8d2d-82de651f8f84 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:07.351653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a3aaf-586c-4786-8d2d-82de651f8f84 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:07.351653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a3aaf-586c-4786-8d2d-82de651f8f84 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:07.353420 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 665/1318] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:07.358545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116bf62-437f-4878-8eb4-e7697b2bd040 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:07.358956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116bf62-437f-4878-8eb4-e7697b2bd040 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:07.359118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116bf62-437f-4878-8eb4-e7697b2bd040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:07.421540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c116bf62-437f-4878-8eb4-e7697b2bd040 None None] MFA Rules not processed for user `48947de8105644d9bd2143a64e99e110`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:07.422719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c116bf62-437f-4878-8eb4-e7697b2bd040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:07.513012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 654/1319] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:30:07.552456 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a3aaf-586c-4786-8d2d-82de651f8f84 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:07.553969 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a04a3aaf-586c-4786-8d2d-82de651f8f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:07.655375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a3aaf-586c-4786-8d2d-82de651f8f84 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:07.723341 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92201778-997d-4470-9b59-f348f72b9341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:07.723964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201778-997d-4470-9b59-f348f72b9341 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:07.724241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201778-997d-4470-9b59-f348f72b9341 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:07.724510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201778-997d-4470-9b59-f348f72b9341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:07.726134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-92201778-997d-4470-9b59-f348f72b9341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:07.827486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92201778-997d-4470-9b59-f348f72b9341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:07.828886 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92201778-997d-4470-9b59-f348f72b9341 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:07.845619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 666/1320] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:30:10.680951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d05218-0905-48dd-a76e-a2dad1bb3735 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:10.681471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d05218-0905-48dd-a76e-a2dad1bb3735 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:10.681471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d05218-0905-48dd-a76e-a2dad1bb3735 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:10.683323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 655/1321] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:10.688481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ae277-97a4-4953-9267-cda1c07294cb None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:10.688861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ae277-97a4-4953-9267-cda1c07294cb None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:10.689030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ae277-97a4-4953-9267-cda1c07294cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:10.751616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-358ae277-97a4-4953-9267-cda1c07294cb None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:10.752809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-358ae277-97a4-4953-9267-cda1c07294cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:10.844520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 667/1322] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:10.883833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d05218-0905-48dd-a76e-a2dad1bb3735 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:10.885333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-17d05218-0905-48dd-a76e-a2dad1bb3735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:10.983208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d05218-0905-48dd-a76e-a2dad1bb3735 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:11.054086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613d98b-25de-4994-a198-9d9777ba452d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:11.054725 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d98b-25de-4994-a198-9d9777ba452d service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:11.055032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d98b-25de-4994-a198-9d9777ba452d service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:11.055303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d98b-25de-4994-a198-9d9777ba452d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:11.056921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9613d98b-25de-4994-a198-9d9777ba452d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:11.159877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613d98b-25de-4994-a198-9d9777ba452d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:11.161294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613d98b-25de-4994-a198-9d9777ba452d service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:11.179791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 656/1323] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:30:14.124429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbb2ba-53ed-45cd-a697-6d59bdf9578c None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:14.124939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbb2ba-53ed-45cd-a697-6d59bdf9578c None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:14.125021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbb2ba-53ed-45cd-a697-6d59bdf9578c None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:14.130291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 668/1324] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:14.132922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754b7a-ad0c-48c7-b927-d207b7258f7e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:14.133317 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754b7a-ad0c-48c7-b927-d207b7258f7e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:14.133433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754b7a-ad0c-48c7-b927-d207b7258f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:14.201191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0e754b7a-ad0c-48c7-b927-d207b7258f7e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:14.202499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0e754b7a-ad0c-48c7-b927-d207b7258f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:14.300236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 657/1325] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:14.336867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbb2ba-53ed-45cd-a697-6d59bdf9578c None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:14.338324 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-32cbb2ba-53ed-45cd-a697-6d59bdf9578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:14.445524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbb2ba-53ed-45cd-a697-6d59bdf9578c None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:14.522242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f468bdc-8d17-4b7f-a37b-1d2bed4f19fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:14.522896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f468bdc-8d17-4b7f-a37b-1d2bed4f19fb service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:14.523200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f468bdc-8d17-4b7f-a37b-1d2bed4f19fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:14.523473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f468bdc-8d17-4b7f-a37b-1d2bed4f19fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:14.525398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4f468bdc-8d17-4b7f-a37b-1d2bed4f19fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:14.636958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f468bdc-8d17-4b7f-a37b-1d2bed4f19fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:14.638768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f468bdc-8d17-4b7f-a37b-1d2bed4f19fb service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:14.657332 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 669/1326] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:30:17.044384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6827633-f065-4815-a9b1-73926d7623b2 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:17.044942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6827633-f065-4815-a9b1-73926d7623b2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:17.044942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6827633-f065-4815-a9b1-73926d7623b2 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:17.046740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 658/1327] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:17.052496 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e8ddb-b2ef-45e6-b30c-d5027b994a58 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:17.053551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e8ddb-b2ef-45e6-b30c-d5027b994a58 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:17.053675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e8ddb-b2ef-45e6-b30c-d5027b994a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:17.118684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6d0e8ddb-b2ef-45e6-b30c-d5027b994a58 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:17.119912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6d0e8ddb-b2ef-45e6-b30c-d5027b994a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:17.215536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 670/1328] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:17.252968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6827633-f065-4815-a9b1-73926d7623b2 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:17.254478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f6827633-f065-4815-a9b1-73926d7623b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:17.353348 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6827633-f065-4815-a9b1-73926d7623b2 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:17.428852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f915a2-c9ed-4bc3-83cd-26f97bf74055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:17.429498 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f915a2-c9ed-4bc3-83cd-26f97bf74055 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:17.429777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f915a2-c9ed-4bc3-83cd-26f97bf74055 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:17.430048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f915a2-c9ed-4bc3-83cd-26f97bf74055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:17.431716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-20f915a2-c9ed-4bc3-83cd-26f97bf74055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:17.537242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f915a2-c9ed-4bc3-83cd-26f97bf74055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:17.538694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f915a2-c9ed-4bc3-83cd-26f97bf74055 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:17.556928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 659/1329] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:30:19.910852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d5634-87ca-4a71-b77e-17e57bdc5876 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:19.911405 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d5634-87ca-4a71-b77e-17e57bdc5876 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:19.911405 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d5634-87ca-4a71-b77e-17e57bdc5876 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:19.913852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 671/1330] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:19.919210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f9be9-57d1-44fa-a9dc-cfadab16df3f None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:19.919655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f9be9-57d1-44fa-a9dc-cfadab16df3f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:19.919748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f9be9-57d1-44fa-a9dc-cfadab16df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:19.987225 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-cf6f9be9-57d1-44fa-a9dc-cfadab16df3f None None] MFA Rules not processed for user `48947de8105644d9bd2143a64e99e110`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:19.988422 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-cf6f9be9-57d1-44fa-a9dc-cfadab16df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:20.082276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 660/1331] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:20.120009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d5634-87ca-4a71-b77e-17e57bdc5876 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:20.121526 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ae1d5634-87ca-4a71-b77e-17e57bdc5876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:20.223141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d5634-87ca-4a71-b77e-17e57bdc5876 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:20.294881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed5cb3-07dc-4c45-b4f4-ca5c2da6ca46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:20.295552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5cb3-07dc-4c45-b4f4-ca5c2da6ca46 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:20.295829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5cb3-07dc-4c45-b4f4-ca5c2da6ca46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:20.296097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5cb3-07dc-4c45-b4f4-ca5c2da6ca46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:20.298039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-61ed5cb3-07dc-4c45-b4f4-ca5c2da6ca46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:20.402184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed5cb3-07dc-4c45-b4f4-ca5c2da6ca46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:20.403643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed5cb3-07dc-4c45-b4f4-ca5c2da6ca46 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:20.420974 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 672/1332] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:30:22.954690 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5940-b147-4ef7-bca9-bf49cca88085 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:22.955229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5940-b147-4ef7-bca9-bf49cca88085 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:22.955340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5940-b147-4ef7-bca9-bf49cca88085 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:22.957051 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 661/1333] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:22.963119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746e614-e6c2-480a-92e9-7f3da7694e0b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:22.963511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746e614-e6c2-480a-92e9-7f3da7694e0b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:22.963672 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746e614-e6c2-480a-92e9-7f3da7694e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:23.028331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-5746e614-e6c2-480a-92e9-7f3da7694e0b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:23.029532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5746e614-e6c2-480a-92e9-7f3da7694e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:23.125167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 673/1334] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:23.162020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b5940-b147-4ef7-bca9-bf49cca88085 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:23.163556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-cc6b5940-b147-4ef7-bca9-bf49cca88085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:23.268116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b5940-b147-4ef7-bca9-bf49cca88085 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:23.341693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513d2a3-1947-4c07-a29b-a6c80010b203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:23.342346 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513d2a3-1947-4c07-a29b-a6c80010b203 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:23.342699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513d2a3-1947-4c07-a29b-a6c80010b203 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:23.343001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513d2a3-1947-4c07-a29b-a6c80010b203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:23.344636 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9513d2a3-1947-4c07-a29b-a6c80010b203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:23.450216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513d2a3-1947-4c07-a29b-a6c80010b203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:23.451621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513d2a3-1947-4c07-a29b-a6c80010b203 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:23.469083 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 662/1335] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:30:25.811795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1140c05-e1fb-4d87-9551-dea0dc148530 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:25.812431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1140c05-e1fb-4d87-9551-dea0dc148530 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:25.812431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1140c05-e1fb-4d87-9551-dea0dc148530 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:25.814125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 674/1336] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:25.819854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d80de-833a-4e45-95e0-a4b583e6cf5d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:25.820275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d80de-833a-4e45-95e0-a4b583e6cf5d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:25.820386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d80de-833a-4e45-95e0-a4b583e6cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:25.883038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c13d80de-833a-4e45-95e0-a4b583e6cf5d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:25.884212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c13d80de-833a-4e45-95e0-a4b583e6cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:25.976791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 663/1337] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:26.032366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cf6c8-569c-4a98-a345-42f3cb86ca89 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:26.032653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cf6c8-569c-4a98-a345-42f3cb86ca89 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:26.032929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cf6c8-569c-4a98-a345-42f3cb86ca89 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:26.034699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 675/1338] 10.222.0.44 () {54 vars in 964 bytes} [Mon Feb 28 10:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:26.040932 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160752-623e-4999-8f78-efb6f917090b None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:26.041223 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160752-623e-4999-8f78-efb6f917090b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:26.041499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160752-623e-4999-8f78-efb6f917090b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:26.114610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-37160752-623e-4999-8f78-efb6f917090b None None] MFA Rules not processed for user `44fb3491570c41cbb7271cfce1c31e39`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:26.115833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-37160752-623e-4999-8f78-efb6f917090b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:26.199299 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 664/1339] 10.222.0.44 () {58 vars in 1061 bytes} [Mon Feb 28 10:30:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:26.207971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cf6c8-569c-4a98-a345-42f3cb86ca89 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:26.209537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c77cf6c8-569c-4a98-a345-42f3cb86ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:26.311754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cf6c8-569c-4a98-a345-42f3cb86ca89 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:26.382755 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a657453-abfb-46e6-9938-d3f8e3aee456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:26.383441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a657453-abfb-46e6-9938-d3f8e3aee456 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:26.383719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a657453-abfb-46e6-9938-d3f8e3aee456 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:26.383985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a657453-abfb-46e6-9938-d3f8e3aee456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:26.385595 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3a657453-abfb-46e6-9938-d3f8e3aee456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:26.491603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a657453-abfb-46e6-9938-d3f8e3aee456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:26.493061 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a657453-abfb-46e6-9938-d3f8e3aee456 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:26.511021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 676/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:30:29.656529 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630b53-118c-4de2-b642-61c448251864 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:29.657059 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630b53-118c-4de2-b642-61c448251864 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:29.657059 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630b53-118c-4de2-b642-61c448251864 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:29.658892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 665/1341] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:29.664315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144296-7543-4e27-8cd9-2bdf4d923cf3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:29.664726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144296-7543-4e27-8cd9-2bdf4d923cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:29.664935 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144296-7543-4e27-8cd9-2bdf4d923cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:29.731271 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-46144296-7543-4e27-8cd9-2bdf4d923cf3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:29.732439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-46144296-7543-4e27-8cd9-2bdf4d923cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:29.831042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 677/1342] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:29.867467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630b53-118c-4de2-b642-61c448251864 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:29.869700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7f630b53-118c-4de2-b642-61c448251864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:29.962337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630b53-118c-4de2-b642-61c448251864 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:29.965772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f70cb6-73c8-4e0c-bf9d-2d878edceb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:29.966399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f70cb6-73c8-4e0c-bf9d-2d878edceb8f service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:29.966672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f70cb6-73c8-4e0c-bf9d-2d878edceb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:29.966964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f70cb6-73c8-4e0c-bf9d-2d878edceb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:29.975573 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f70cb6-73c8-4e0c-bf9d-2d878edceb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:29.976969 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f70cb6-73c8-4e0c-bf9d-2d878edceb8f service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:29.985986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 666/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:30:34.468862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18339cf-61fd-44ff-abcb-3c9e5ce42b38 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:34.469449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18339cf-61fd-44ff-abcb-3c9e5ce42b38 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:34.469449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18339cf-61fd-44ff-abcb-3c9e5ce42b38 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:34.471209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 678/1344] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:34.478118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18677b64-d3d1-4ae5-aba5-bda7bfd19640 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:34.478940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18677b64-d3d1-4ae5-aba5-bda7bfd19640 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:34.479211 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18677b64-d3d1-4ae5-aba5-bda7bfd19640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:34.519939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-18677b64-d3d1-4ae5-aba5-bda7bfd19640 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:34.521182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-18677b64-d3d1-4ae5-aba5-bda7bfd19640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:34.602163 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 667/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:34.641727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18339cf-61fd-44ff-abcb-3c9e5ce42b38 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:34.653268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18339cf-61fd-44ff-abcb-3c9e5ce42b38 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:34.656832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d8817-a4f2-4dca-9a8c-8e265d15046c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:34.657458 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8817-a4f2-4dca-9a8c-8e265d15046c service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:34.657735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8817-a4f2-4dca-9a8c-8e265d15046c service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:34.658005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8817-a4f2-4dca-9a8c-8e265d15046c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:34.668180 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d8817-a4f2-4dca-9a8c-8e265d15046c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:34.669733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d8817-a4f2-4dca-9a8c-8e265d15046c service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:34.680602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 679/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:30:37.682023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577eb4a-8c97-404f-aa4c-14088e9303f5 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:37.682610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577eb4a-8c97-404f-aa4c-14088e9303f5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:37.682610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577eb4a-8c97-404f-aa4c-14088e9303f5 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:37.689439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16590-2469-48b3-937b-c2183d02c566 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:37.690292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16590-2469-48b3-937b-c2183d02c566 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:37.690777 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16590-2469-48b3-937b-c2183d02c566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:37.692981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 668/1347] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:37.710821 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-bdd16590-2469-48b3-937b-c2183d02c566 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:37.712808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-bdd16590-2469-48b3-937b-c2183d02c566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:37.721379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 680/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:30:37.759236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577eb4a-8c97-404f-aa4c-14088e9303f5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:37.761144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6577eb4a-8c97-404f-aa4c-14088e9303f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:37.781609 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577eb4a-8c97-404f-aa4c-14088e9303f5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:37.785451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7d0a0-761f-4c8b-89cf-3406764728c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:37.786147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7d0a0-761f-4c8b-89cf-3406764728c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:37.786541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7d0a0-761f-4c8b-89cf-3406764728c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:37.787440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7d0a0-761f-4c8b-89cf-3406764728c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:37.799316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7d0a0-761f-4c8b-89cf-3406764728c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:37.800830 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7d0a0-761f-4c8b-89cf-3406764728c2 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:37.810409 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 669/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:30:42.340495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157b7dd-0c0f-462f-9a0b-951550f43dbf None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:42.341398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157b7dd-0c0f-462f-9a0b-951550f43dbf None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:42.341872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157b7dd-0c0f-462f-9a0b-951550f43dbf None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:42.344049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 681/1350] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:42.349284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1350f5-ecc1-4e3f-8fdf-f30a59f6f623 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:42.349778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1350f5-ecc1-4e3f-8fdf-f30a59f6f623 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:42.349964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1350f5-ecc1-4e3f-8fdf-f30a59f6f623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:42.373433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-5a1350f5-ecc1-4e3f-8fdf-f30a59f6f623 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:42.374686 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5a1350f5-ecc1-4e3f-8fdf-f30a59f6f623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:42.383276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 670/1351] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:42.419912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157b7dd-0c0f-462f-9a0b-951550f43dbf None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:42.431121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157b7dd-0c0f-462f-9a0b-951550f43dbf None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:42.434619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03f89d-3c34-433a-9827-853ddbdd3ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:42.435280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03f89d-3c34-433a-9827-853ddbdd3ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:42.435555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03f89d-3c34-433a-9827-853ddbdd3ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:42.435824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03f89d-3c34-433a-9827-853ddbdd3ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:42.445153 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03f89d-3c34-433a-9827-853ddbdd3ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:42.446552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03f89d-3c34-433a-9827-853ddbdd3ae4 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:42.455651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 682/1352] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:30:47.656930 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16c631-f35d-487b-aa24-196f4717ca9f None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:47.657376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16c631-f35d-487b-aa24-196f4717ca9f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:47.657466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16c631-f35d-487b-aa24-196f4717ca9f None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:47.660287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 671/1353] 10.222.0.44 () {54 vars in 921 bytes} [Mon Feb 28 10:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:47.665540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3637988-f3d8-40ae-a0e3-67a6ffdd784d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:47.665972 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3637988-f3d8-40ae-a0e3-67a6ffdd784d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:47.666098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3637988-f3d8-40ae-a0e3-67a6ffdd784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:47.763986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-b3637988-f3d8-40ae-a0e3-67a6ffdd784d None None] MFA Rules not processed for user `ee30c8013ebb40a99d1eac7820d7f1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:47.765193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-b3637988-f3d8-40ae-a0e3-67a6ffdd784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:47.862284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 683/1354] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Feb 28 10:30:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:52.316798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e6822-0a37-4dc4-9331-104590bf04e9 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:52.317825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e6822-0a37-4dc4-9331-104590bf04e9 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:52.318122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e6822-0a37-4dc4-9331-104590bf04e9 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:52.320168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 672/1355] 10.222.0.44 () {54 vars in 921 bytes} [Mon Feb 28 10:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:52.325054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da469d-c61b-4c05-be8d-e8fcda790f52 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:52.325463 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da469d-c61b-4c05-be8d-e8fcda790f52 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:52.325622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da469d-c61b-4c05-be8d-e8fcda790f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:52.345008 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e3da469d-c61b-4c05-be8d-e8fcda790f52 None None] MFA Rules not processed for user `ee30c8013ebb40a99d1eac7820d7f1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:52.346127 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e3da469d-c61b-4c05-be8d-e8fcda790f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:52.355039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 684/1356] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Feb 28 10:30:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:53.794978 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80493c1b-32f7-44f0-99c8-519ad38b1466 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:53.795493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80493c1b-32f7-44f0-99c8-519ad38b1466 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:53.795493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80493c1b-32f7-44f0-99c8-519ad38b1466 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:53.797264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 673/1357] 10.222.0.44 () {54 vars in 921 bytes} [Mon Feb 28 10:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:53.802354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcea2c-805d-4de4-a994-4141087fb6b3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:53.802781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcea2c-805d-4de4-a994-4141087fb6b3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:53.802919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcea2c-805d-4de4-a994-4141087fb6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:53.821672 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-34fcea2c-805d-4de4-a994-4141087fb6b3 None None] MFA Rules not processed for user `ee30c8013ebb40a99d1eac7820d7f1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:53.822855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-34fcea2c-805d-4de4-a994-4141087fb6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:53.831610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 685/1358] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Feb 28 10:30:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:57.610318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c956f-734b-4200-ba40-e2255689a6ea None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:57.610951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c956f-734b-4200-ba40-e2255689a6ea None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:57.611202 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c956f-734b-4200-ba40-e2255689a6ea None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:57.613275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 674/1359] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:57.618316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751e798-3358-4e0c-83fc-1668ae6a30a7 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:57.618717 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751e798-3358-4e0c-83fc-1668ae6a30a7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:57.618868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751e798-3358-4e0c-83fc-1668ae6a30a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:57.639227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2751e798-3358-4e0c-83fc-1668ae6a30a7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:57.640426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2751e798-3358-4e0c-83fc-1668ae6a30a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:57.649230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 686/1360] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:57.697584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a87d-15ce-4255-b483-46d419dcc7c7 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:57.697980 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a87d-15ce-4255-b483-46d419dcc7c7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:57.698358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a87d-15ce-4255-b483-46d419dcc7c7 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:57.700576 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 675/1361] 10.222.0.44 () {54 vars in 961 bytes} [Mon Feb 28 10:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:30:57.706226 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b567-5ef3-4a0b-8e40-fdb6d84912d6 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:57.706644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b567-5ef3-4a0b-8e40-fdb6d84912d6 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:57.707056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b567-5ef3-4a0b-8e40-fdb6d84912d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:57.755498 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-fa89b567-5ef3-4a0b-8e40-fdb6d84912d6 None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:30:57.756810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fa89b567-5ef3-4a0b-8e40-fdb6d84912d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:30:57.841451 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 687/1362] 10.222.0.44 () {58 vars in 1058 bytes} [Mon Feb 28 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:30:57.850023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655a87d-15ce-4255-b483-46d419dcc7c7 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:30:57.865846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655a87d-15ce-4255-b483-46d419dcc7c7 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:30:57.871267 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f75176-2a09-4bc4-902a-fa2b07b00c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:30:57.872075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f75176-2a09-4bc4-902a-fa2b07b00c84 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:30:57.872533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f75176-2a09-4bc4-902a-fa2b07b00c84 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:30:57.872956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f75176-2a09-4bc4-902a-fa2b07b00c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:30:57.881902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f75176-2a09-4bc4-902a-fa2b07b00c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:30:57.884460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f75176-2a09-4bc4-902a-fa2b07b00c84 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:30:57.896149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 676/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:00.434130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f080b11-dda1-4aeb-89ed-8d1181396f16 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:00.435028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f080b11-dda1-4aeb-89ed-8d1181396f16 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:00.435487 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f080b11-dda1-4aeb-89ed-8d1181396f16 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:00.441862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 688/1364] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:00.444325 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24541756-232f-46e6-b5e6-cd51f4ef3431 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:00.444809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24541756-232f-46e6-b5e6-cd51f4ef3431 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:00.444905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24541756-232f-46e6-b5e6-cd51f4ef3431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:00.464454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-24541756-232f-46e6-b5e6-cd51f4ef3431 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:00.465917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-24541756-232f-46e6-b5e6-cd51f4ef3431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:00.477523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 677/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:00.519726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f080b11-dda1-4aeb-89ed-8d1181396f16 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:00.534594 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f080b11-dda1-4aeb-89ed-8d1181396f16 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:00.541818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cacda-800e-4ec3-a86b-d7cc590ac159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:00.542448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cacda-800e-4ec3-a86b-d7cc590ac159 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:00.542728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cacda-800e-4ec3-a86b-d7cc590ac159 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:00.543020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cacda-800e-4ec3-a86b-d7cc590ac159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:00.552561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cacda-800e-4ec3-a86b-d7cc590ac159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:00.554118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cacda-800e-4ec3-a86b-d7cc590ac159 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:00.564634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 689/1366] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:31:03.178597 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec889a-0228-4881-8072-77f8ab7069e5 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:03.179192 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec889a-0228-4881-8072-77f8ab7069e5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:03.179192 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec889a-0228-4881-8072-77f8ab7069e5 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:03.180936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 678/1367] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:03.186560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618a719-a853-4f46-8c3e-7aa433b9c1c0 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:03.187022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618a719-a853-4f46-8c3e-7aa433b9c1c0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:03.187155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618a719-a853-4f46-8c3e-7aa433b9c1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:03.204551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-3618a719-a853-4f46-8c3e-7aa433b9c1c0 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:03.205749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3618a719-a853-4f46-8c3e-7aa433b9c1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:03.213877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 690/1368] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:03.258858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14cb7c-e449-427c-a3c6-419e282c1347 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:03.259190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14cb7c-e449-427c-a3c6-419e282c1347 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:03.259419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14cb7c-e449-427c-a3c6-419e282c1347 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:03.261154 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 679/1369] 10.222.0.44 () {54 vars in 961 bytes} [Mon Feb 28 10:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:03.266393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3bd5-4610-4d9f-8a45-575bbfc24110 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:03.266675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3bd5-4610-4d9f-8a45-575bbfc24110 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:03.266982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3bd5-4610-4d9f-8a45-575bbfc24110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:03.285227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-968a3bd5-4610-4d9f-8a45-575bbfc24110 None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:03.287028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-968a3bd5-4610-4d9f-8a45-575bbfc24110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:03.295921 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 691/1370] 10.222.0.44 () {58 vars in 1058 bytes} [Mon Feb 28 10:31:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:31:03.303567 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14cb7c-e449-427c-a3c6-419e282c1347 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:03.322250 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14cb7c-e449-427c-a3c6-419e282c1347 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:03.327746 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748c44-34ef-479f-a3da-b800805d50f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:03.328376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748c44-34ef-479f-a3da-b800805d50f7 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:03.328715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748c44-34ef-479f-a3da-b800805d50f7 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:03.328993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748c44-34ef-479f-a3da-b800805d50f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:03.337972 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8748c44-34ef-479f-a3da-b800805d50f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:03.339518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8748c44-34ef-479f-a3da-b800805d50f7 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:03.349556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 680/1371] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:05.811670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf53f5-95a5-466d-8c95-c4a7d2ce1f45 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:05.812201 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf53f5-95a5-466d-8c95-c4a7d2ce1f45 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:05.812201 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf53f5-95a5-466d-8c95-c4a7d2ce1f45 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:05.814459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 692/1372] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:05.820197 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5125e3-7b57-4136-af63-942ef533e6d5 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:05.820634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5125e3-7b57-4136-af63-942ef533e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:05.820817 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5125e3-7b57-4136-af63-942ef533e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:05.840290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0a5125e3-7b57-4136-af63-942ef533e6d5 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:05.841488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0a5125e3-7b57-4136-af63-942ef533e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:05.851041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 681/1373] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:05.889882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93dfd-f832-4254-bb64-3715509ac856 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:05.890173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93dfd-f832-4254-bb64-3715509ac856 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:05.890478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93dfd-f832-4254-bb64-3715509ac856 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:05.892333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 693/1374] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:05.894526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5125e3-7b57-4136-af63-942ef533e6d5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:05.898082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4aca-2bc1-406c-b678-42ff68b9b559 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:05.898369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4aca-2bc1-406c-b678-42ff68b9b559 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:05.898711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4aca-2bc1-406c-b678-42ff68b9b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:05.909285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5125e3-7b57-4136-af63-942ef533e6d5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:05.915040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc255c-5f19-474f-be1c-b978055a5741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:05.915689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc255c-5f19-474f-be1c-b978055a5741 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:05.916077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc255c-5f19-474f-be1c-b978055a5741 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:05.916511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc255c-5f19-474f-be1c-b978055a5741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:05.916623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f2aa4aca-2bc1-406c-b678-42ff68b9b559 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:05.917769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f2aa4aca-2bc1-406c-b678-42ff68b9b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:05.928685 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 694/1375] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:31:05.932744 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc255c-5f19-474f-be1c-b978055a5741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:05.934497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc255c-5f19-474f-be1c-b978055a5741 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:05.945001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 682/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:06.232284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7eaa-1bb3-41b6-b5bb-7e179ff12594 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:06.232784 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7eaa-1bb3-41b6-b5bb-7e179ff12594 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:06.232988 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7eaa-1bb3-41b6-b5bb-7e179ff12594 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:06.235068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 695/1377] 10.222.0.44 () {54 vars in 963 bytes} [Mon Feb 28 10:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:06.239980 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db540cf-f283-4259-baee-4fcccb617267 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:06.240266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db540cf-f283-4259-baee-4fcccb617267 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:06.240536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db540cf-f283-4259-baee-4fcccb617267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:06.291486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-1db540cf-f283-4259-baee-4fcccb617267 None None] MFA Rules not processed for user `e1c59b4bb1774e1badd132071859f503`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:06.292666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-1db540cf-f283-4259-baee-4fcccb617267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:06.351483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 683/1378] 10.222.0.44 () {58 vars in 1060 bytes} [Mon Feb 28 10:31:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:06.358752 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7eaa-1bb3-41b6-b5bb-7e179ff12594 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:06.369771 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7eaa-1bb3-41b6-b5bb-7e179ff12594 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:06.373592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca992d-cb78-4b45-8815-678aaf2c5506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:06.374366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca992d-cb78-4b45-8815-678aaf2c5506 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:06.374728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca992d-cb78-4b45-8815-678aaf2c5506 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:06.375208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca992d-cb78-4b45-8815-678aaf2c5506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:06.384805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca992d-cb78-4b45-8815-678aaf2c5506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:06.386333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca992d-cb78-4b45-8815-678aaf2c5506 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:06.397437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 696/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:31:08.306220 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac230c1-a43b-4b18-bb08-934c78bd40a1 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:08.306751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac230c1-a43b-4b18-bb08-934c78bd40a1 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:08.306751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac230c1-a43b-4b18-bb08-934c78bd40a1 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:08.308498 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 684/1380] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:31:08.314263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bba6e1-2e9b-4ca9-82a5-a3c5fdcb18ae None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:08.314791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bba6e1-2e9b-4ca9-82a5-a3c5fdcb18ae None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:08.314878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bba6e1-2e9b-4ca9-82a5-a3c5fdcb18ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:08.334763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-35bba6e1-2e9b-4ca9-82a5-a3c5fdcb18ae None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:08.336025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-35bba6e1-2e9b-4ca9-82a5-a3c5fdcb18ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:08.344113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 697/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:08.389946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac230c1-a43b-4b18-bb08-934c78bd40a1 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:08.405239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac230c1-a43b-4b18-bb08-934c78bd40a1 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:08.411038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb1eb9-e659-4310-b091-aef0e6f2122c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:08.411676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1eb9-e659-4310-b091-aef0e6f2122c service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:08.411948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1eb9-e659-4310-b091-aef0e6f2122c service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:08.412213 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1eb9-e659-4310-b091-aef0e6f2122c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:08.421482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb1eb9-e659-4310-b091-aef0e6f2122c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:08.423113 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb1eb9-e659-4310-b091-aef0e6f2122c service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:08.433065 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 685/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:10.757998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3dfd8-70d7-42b3-b0a7-117658c4bf57 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:10.758532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3dfd8-70d7-42b3-b0a7-117658c4bf57 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:10.758846 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3dfd8-70d7-42b3-b0a7-117658c4bf57 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:10.760910 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 698/1383] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:10.765970 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bffba-ba74-4712-8826-36aa52097bc2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:10.766405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bffba-ba74-4712-8826-36aa52097bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:10.766504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bffba-ba74-4712-8826-36aa52097bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:10.784616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ee2bffba-ba74-4712-8826-36aa52097bc2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:10.786375 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ee2bffba-ba74-4712-8826-36aa52097bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:10.794118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 686/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:10.838301 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3dfd8-70d7-42b3-b0a7-117658c4bf57 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:10.853119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3dfd8-70d7-42b3-b0a7-117658c4bf57 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:10.858751 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4879be-221d-4c56-8656-2ad0954d007c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:10.859584 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4879be-221d-4c56-8656-2ad0954d007c service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:10.860009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4879be-221d-4c56-8656-2ad0954d007c service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:10.860423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4879be-221d-4c56-8656-2ad0954d007c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:10.868894 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4879be-221d-4c56-8656-2ad0954d007c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:10.870889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4879be-221d-4c56-8656-2ad0954d007c service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:10.880865 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 699/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:13.231126 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4204684-cc43-4289-95a2-b818bc2326a6 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:13.231645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4204684-cc43-4289-95a2-b818bc2326a6 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:13.231645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4204684-cc43-4289-95a2-b818bc2326a6 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:13.233627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 687/1386] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:13.239834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2a22-23b3-43c3-929b-fd85b9dd1a7f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:13.240258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2a22-23b3-43c3-929b-fd85b9dd1a7f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:13.240373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2a22-23b3-43c3-929b-fd85b9dd1a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:13.259318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-0e9a2a22-23b3-43c3-929b-fd85b9dd1a7f None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:13.260508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0e9a2a22-23b3-43c3-929b-fd85b9dd1a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:13.268699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 700/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:13.311350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4204684-cc43-4289-95a2-b818bc2326a6 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:13.328000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4204684-cc43-4289-95a2-b818bc2326a6 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:13.335247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14144662-5c7d-426c-8499-e32a8a376b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:13.336138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14144662-5c7d-426c-8499-e32a8a376b44 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:13.336610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14144662-5c7d-426c-8499-e32a8a376b44 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:13.336947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14144662-5c7d-426c-8499-e32a8a376b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:13.347016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14144662-5c7d-426c-8499-e32a8a376b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:13.349465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14144662-5c7d-426c-8499-e32a8a376b44 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:13.362150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 688/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:15.664192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d90d5-8085-4b01-bc34-ace78428426d None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:15.664783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d90d5-8085-4b01-bc34-ace78428426d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:15.664783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d90d5-8085-4b01-bc34-ace78428426d None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:15.666517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 701/1389] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:15.671883 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e35194-d1a5-4c45-910b-6ee08bcf2c92 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:15.672371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e35194-d1a5-4c45-910b-6ee08bcf2c92 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:15.672472 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e35194-d1a5-4c45-910b-6ee08bcf2c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:15.690048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e7e35194-d1a5-4c45-910b-6ee08bcf2c92 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:15.691256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e7e35194-d1a5-4c45-910b-6ee08bcf2c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:15.699566 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 689/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:15.744658 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d90d5-8085-4b01-bc34-ace78428426d None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:15.759594 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d90d5-8085-4b01-bc34-ace78428426d None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:15.765811 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ab7e6-2915-4116-aa0d-52e6bfd00a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:15.766443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ab7e6-2915-4116-aa0d-52e6bfd00a0f service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:15.766719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ab7e6-2915-4116-aa0d-52e6bfd00a0f service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:15.767022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ab7e6-2915-4116-aa0d-52e6bfd00a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:15.776157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ab7e6-2915-4116-aa0d-52e6bfd00a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:15.777727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ab7e6-2915-4116-aa0d-52e6bfd00a0f service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:15.786836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 702/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:18.605011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2eaa42-b9ea-4448-89ea-28ec9d34e33e None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:18.605709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2eaa42-b9ea-4448-89ea-28ec9d34e33e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:18.605709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2eaa42-b9ea-4448-89ea-28ec9d34e33e None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:18.607370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 690/1392] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:18.612900 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48c34-8e04-42ba-8df0-57491564de97 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:18.613338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48c34-8e04-42ba-8df0-57491564de97 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:18.614049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48c34-8e04-42ba-8df0-57491564de97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:18.632647 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-cea48c34-8e04-42ba-8df0-57491564de97 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:18.633852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cea48c34-8e04-42ba-8df0-57491564de97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:18.642285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 703/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:18.689040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2eaa42-b9ea-4448-89ea-28ec9d34e33e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:18.703856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2eaa42-b9ea-4448-89ea-28ec9d34e33e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:18.710701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6942250-f344-4e7a-a6f8-f85d88c44ee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:18.711464 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6942250-f344-4e7a-a6f8-f85d88c44ee3 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:18.711752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6942250-f344-4e7a-a6f8-f85d88c44ee3 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:18.712031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6942250-f344-4e7a-a6f8-f85d88c44ee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:18.721308 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6942250-f344-4e7a-a6f8-f85d88c44ee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:18.723651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6942250-f344-4e7a-a6f8-f85d88c44ee3 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:18.734169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 691/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:21.129742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f101-904b-4515-8ad1-a50a6cc02630 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:21.130321 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f101-904b-4515-8ad1-a50a6cc02630 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:21.130425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f101-904b-4515-8ad1-a50a6cc02630 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:21.132318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 704/1395] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:21.137838 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c32ff3-cb13-4de0-ad31-f87ad4eaeb82 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:21.138294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c32ff3-cb13-4de0-ad31-f87ad4eaeb82 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:21.138514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c32ff3-cb13-4de0-ad31-f87ad4eaeb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:21.156142 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-91c32ff3-cb13-4de0-ad31-f87ad4eaeb82 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:21.157323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-91c32ff3-cb13-4de0-ad31-f87ad4eaeb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:21.165169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 692/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:21.209055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7f101-904b-4515-8ad1-a50a6cc02630 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:21.223704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7f101-904b-4515-8ad1-a50a6cc02630 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:21.229012 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f47d95-542b-48ac-b5f6-c1de0deb3632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:21.229637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f47d95-542b-48ac-b5f6-c1de0deb3632 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:21.229920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f47d95-542b-48ac-b5f6-c1de0deb3632 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:21.230198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f47d95-542b-48ac-b5f6-c1de0deb3632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:21.238235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f47d95-542b-48ac-b5f6-c1de0deb3632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:21.240399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f47d95-542b-48ac-b5f6-c1de0deb3632 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:21.249613 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 705/1397] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:22.447645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7c3a6-18e7-4197-ba4e-05f0b6a89815 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:22.448221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7c3a6-18e7-4197-ba4e-05f0b6a89815 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:22.448221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7c3a6-18e7-4197-ba4e-05f0b6a89815 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:22.449966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 693/1398] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:22.455314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050595d-7506-42b2-a86c-2c734d3b58d4 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:22.455733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050595d-7506-42b2-a86c-2c734d3b58d4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:22.455902 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050595d-7506-42b2-a86c-2c734d3b58d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:22.473674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-0050595d-7506-42b2-a86c-2c734d3b58d4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:22.474879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0050595d-7506-42b2-a86c-2c734d3b58d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:22.482642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 706/1399] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:22.540107 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4b6d-1353-4314-8564-48684dac33d2 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:22.540460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4b6d-1353-4314-8564-48684dac33d2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:22.540800 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4b6d-1353-4314-8564-48684dac33d2 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:22.542697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 694/1400] 10.222.0.44 () {54 vars in 962 bytes} [Mon Feb 28 10:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:22.547611 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4e84-9aab-4472-b61c-3ef339610557 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:22.547902 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4e84-9aab-4472-b61c-3ef339610557 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:22.548176 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4e84-9aab-4472-b61c-3ef339610557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:22.595800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-241e4e84-9aab-4472-b61c-3ef339610557 None None] MFA Rules not processed for user `80ad61a348b2450baceb030f98150647`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:22.596987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-241e4e84-9aab-4472-b61c-3ef339610557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:22.655967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 707/1401] 10.222.0.44 () {58 vars in 1059 bytes} [Mon Feb 28 10:31:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:22.663897 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f4b6d-1353-4314-8564-48684dac33d2 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:22.674383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f4b6d-1353-4314-8564-48684dac33d2 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:22.677982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6602d-45f1-49ba-8312-ccd416294686 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ad61a348b2450baceb030f98150647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:22.678675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6602d-45f1-49ba-8312-ccd416294686 service glance] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:22.679056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6602d-45f1-49ba-8312-ccd416294686 service glance] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:22.679342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6602d-45f1-49ba-8312-ccd416294686 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:22.688157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6602d-45f1-49ba-8312-ccd416294686 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:22.689573 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6602d-45f1-49ba-8312-ccd416294686 service glance] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:22.699372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 695/1402] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:31:23.116047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7ddb-9ba5-43ef-9007-c03fe1584a8e None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:23.116335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7ddb-9ba5-43ef-9007-c03fe1584a8e None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:23.116607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7ddb-9ba5-43ef-9007-c03fe1584a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:23.164811 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-bebe7ddb-9ba5-43ef-9007-c03fe1584a8e None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:23.166003 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-bebe7ddb-9ba5-43ef-9007-c03fe1584a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:23.231130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 708/1403] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:31:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:23.275738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04961d4d-4927-4963-a8c0-90a099d69230 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:23.276112 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04961d4d-4927-4963-a8c0-90a099d69230 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:23.276453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04961d4d-4927-4963-a8c0-90a099d69230 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:23.278355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 696/1404] 10.222.0.44 () {54 vars in 942 bytes} [Mon Feb 28 10:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:23.284674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dbbc2-3d52-473c-be23-f0a49e1667f1 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:23.285102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dbbc2-3d52-473c-be23-f0a49e1667f1 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:23.286000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dbbc2-3d52-473c-be23-f0a49e1667f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:23.332584 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-bf7dbbc2-3d52-473c-be23-f0a49e1667f1 None None] MFA Rules not processed for user `4f6db1c2542943928de6132ec9e61c84`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:23.333770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-bf7dbbc2-3d52-473c-be23-f0a49e1667f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:23.403180 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 709/1405] 10.222.0.44 () {58 vars in 1039 bytes} [Mon Feb 28 10:31:23 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:23.412937 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04961d4d-4927-4963-a8c0-90a099d69230 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:23.426132 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04961d4d-4927-4963-a8c0-90a099d69230 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:23.431034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bcd97-dc31-45b1-b137-528434f36d27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:23.431664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bcd97-dc31-45b1-b137-528434f36d27 service swift] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:23.431941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bcd97-dc31-45b1-b137-528434f36d27 service swift] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:23.432211 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bcd97-dc31-45b1-b137-528434f36d27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:23.439996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bcd97-dc31-45b1-b137-528434f36d27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:23.442085 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bcd97-dc31-45b1-b137-528434f36d27 service swift] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:23.449862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 697/1406] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:31:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:31:23.556352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ace65-2e49-40ba-bb1c-d6eaf57402f7 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:23.556808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ace65-2e49-40ba-bb1c-d6eaf57402f7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:23.556922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ace65-2e49-40ba-bb1c-d6eaf57402f7 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:23.558653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 710/1407] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:23.563980 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a94ed3-edcd-4b0a-830a-e772e76d0a21 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:23.564266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a94ed3-edcd-4b0a-830a-e772e76d0a21 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:23.564550 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a94ed3-edcd-4b0a-830a-e772e76d0a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:23.590995 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-12a94ed3-edcd-4b0a-830a-e772e76d0a21 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:23.592219 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-12a94ed3-edcd-4b0a-830a-e772e76d0a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:23.600288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 698/1408] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:23.643630 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ace65-2e49-40ba-bb1c-d6eaf57402f7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:23.658350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ace65-2e49-40ba-bb1c-d6eaf57402f7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:23.665262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee7ba9-3c54-45d1-aa26-7e5a7f6eb17d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:23.666007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee7ba9-3c54-45d1-aa26-7e5a7f6eb17d service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:23.666545 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee7ba9-3c54-45d1-aa26-7e5a7f6eb17d service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:23.666937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee7ba9-3c54-45d1-aa26-7e5a7f6eb17d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:23.677765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee7ba9-3c54-45d1-aa26-7e5a7f6eb17d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:23.679498 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee7ba9-3c54-45d1-aa26-7e5a7f6eb17d service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:23.688907 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 711/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:26.089947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313085-a62d-4e62-b2bc-9e353cafef16 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:26.090435 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313085-a62d-4e62-b2bc-9e353cafef16 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:26.090531 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313085-a62d-4e62-b2bc-9e353cafef16 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:26.092263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 699/1410] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:26.097520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd46af-657f-471c-b8c4-851ea66bc44d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:26.098350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd46af-657f-471c-b8c4-851ea66bc44d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:26.098638 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd46af-657f-471c-b8c4-851ea66bc44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:26.117864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f3cd46af-657f-471c-b8c4-851ea66bc44d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:26.119174 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f3cd46af-657f-471c-b8c4-851ea66bc44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:26.130946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 712/1411] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:31:26.171481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6313085-a62d-4e62-b2bc-9e353cafef16 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:26.187004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6313085-a62d-4e62-b2bc-9e353cafef16 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:26.195104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ad736-5867-4b2d-8fdf-354af2b18065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:26.196013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ad736-5867-4b2d-8fdf-354af2b18065 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:26.197059 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ad736-5867-4b2d-8fdf-354af2b18065 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:26.197059 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ad736-5867-4b2d-8fdf-354af2b18065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:26.206201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ad736-5867-4b2d-8fdf-354af2b18065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:26.208349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ad736-5867-4b2d-8fdf-354af2b18065 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:26.218204 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 700/1412] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:46.426627 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5530bf4-c138-47a7-946b-5cd801e109e0 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:46.427296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5530bf4-c138-47a7-946b-5cd801e109e0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:46.427296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5530bf4-c138-47a7-946b-5cd801e109e0 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:46.428970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 713/1413] 10.222.0.44 () {54 vars in 918 bytes} [Mon Feb 28 10:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:46.434190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d26f-6c45-49ed-9b71-c73783f667eb None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:46.434672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d26f-6c45-49ed-9b71-c73783f667eb None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:46.434776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d26f-6c45-49ed-9b71-c73783f667eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:46.452147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-5702d26f-6c45-49ed-9b71-c73783f667eb None None] MFA Rules not processed for user `ee30c8013ebb40a99d1eac7820d7f1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:46.453342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5702d26f-6c45-49ed-9b71-c73783f667eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:46.462656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 701/1414] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Feb 28 10:31:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:46.477427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137d1d0-1656-49d8-a3b8-097443407a01 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:46.477710 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137d1d0-1656-49d8-a3b8-097443407a01 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:46.477979 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137d1d0-1656-49d8-a3b8-097443407a01 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:46.479740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 714/1415] 10.222.0.44 () {54 vars in 918 bytes} [Mon Feb 28 10:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:46.484240 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb902-92bb-4b38-be94-2e4c17cfb631 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:46.484547 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb902-92bb-4b38-be94-2e4c17cfb631 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:46.484842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb902-92bb-4b38-be94-2e4c17cfb631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:46.501900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0b6eb902-92bb-4b38-be94-2e4c17cfb631 None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:46.503086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0b6eb902-92bb-4b38-be94-2e4c17cfb631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:46.513071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 702/1416] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Feb 28 10:31:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:31:49.244510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0cb8c-092b-45d0-a916-7512f0008047 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:49.245086 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0cb8c-092b-45d0-a916-7512f0008047 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:49.245086 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0cb8c-092b-45d0-a916-7512f0008047 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:49.246922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:49.252503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8d89-d819-441d-8608-491d95a5cc65 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:49.252916 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8d89-d819-441d-8608-491d95a5cc65 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:49.253059 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8d89-d819-441d-8608-491d95a5cc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:49.270438 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-670b8d89-d819-441d-8608-491d95a5cc65 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:49.271640 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-670b8d89-d819-441d-8608-491d95a5cc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:49.279243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:31:49.321572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0cb8c-092b-45d0-a916-7512f0008047 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:49.336384 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0cb8c-092b-45d0-a916-7512f0008047 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:49.342103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb00a9-8f52-4ca0-90b9-f16582847a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:49.342720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb00a9-8f52-4ca0-90b9-f16582847a38 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:49.343032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb00a9-8f52-4ca0-90b9-f16582847a38 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:49.343347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb00a9-8f52-4ca0-90b9-f16582847a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:49.351863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb00a9-8f52-4ca0-90b9-f16582847a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:49.353418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb00a9-8f52-4ca0-90b9-f16582847a38 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:49.362438 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 716/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:50.730213 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3803-0f95-49df-a514-dd9b69eb0670 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:50.730813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3803-0f95-49df-a514-dd9b69eb0670 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:50.730813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3803-0f95-49df-a514-dd9b69eb0670 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:50.732672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:50.737516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f54dc-51a2-4709-a775-5fc1dc9edd81 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:50.737970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f54dc-51a2-4709-a775-5fc1dc9edd81 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:50.738068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f54dc-51a2-4709-a775-5fc1dc9edd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:50.756471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-5e2f54dc-51a2-4709-a775-5fc1dc9edd81 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:50.757925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5e2f54dc-51a2-4709-a775-5fc1dc9edd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:50.765625 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:50.949505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a3803-0f95-49df-a514-dd9b69eb0670 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:50.963992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a3803-0f95-49df-a514-dd9b69eb0670 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:50.969877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c016cf-1cef-47d3-9a49-2a0bcb394b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:50.970492 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c016cf-1cef-47d3-9a49-2a0bcb394b4e service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:50.970763 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c016cf-1cef-47d3-9a49-2a0bcb394b4e service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:50.971053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c016cf-1cef-47d3-9a49-2a0bcb394b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:50.979529 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c016cf-1cef-47d3-9a49-2a0bcb394b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:50.981136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c016cf-1cef-47d3-9a49-2a0bcb394b4e service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:50.990543 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 705/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:52.311269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847beda3-17d3-46f5-b22d-c719b079f680 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:52.311829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847beda3-17d3-46f5-b22d-c719b079f680 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:52.311829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847beda3-17d3-46f5-b22d-c719b079f680 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:52.313630 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:52.318986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344b7f-584f-42af-a8d3-46b8d3082696 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:52.319419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344b7f-584f-42af-a8d3-46b8d3082696 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:52.319535 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344b7f-584f-42af-a8d3-46b8d3082696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:52.337740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-35344b7f-584f-42af-a8d3-46b8d3082696 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:52.338845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-35344b7f-584f-42af-a8d3-46b8d3082696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:52.346482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:52.501932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847beda3-17d3-46f5-b22d-c719b079f680 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:52.516769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847beda3-17d3-46f5-b22d-c719b079f680 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:52.522010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b164df-a664-4fe5-97dc-ea2c1b5f766d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:52.522631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b164df-a664-4fe5-97dc-ea2c1b5f766d service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:52.522930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b164df-a664-4fe5-97dc-ea2c1b5f766d service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:52.523206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b164df-a664-4fe5-97dc-ea2c1b5f766d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:52.531291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b164df-a664-4fe5-97dc-ea2c1b5f766d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:52.532839 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b164df-a664-4fe5-97dc-ea2c1b5f766d service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:52.541806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 719/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:53.829167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57848c40-9164-4893-a6d5-3394e4948647 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:53.829815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57848c40-9164-4893-a6d5-3394e4948647 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:53.829815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57848c40-9164-4893-a6d5-3394e4948647 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:53.831628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:53.836520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eaf98-03e5-4859-a09d-e4ae2961de7b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:53.836927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eaf98-03e5-4859-a09d-e4ae2961de7b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:53.837163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eaf98-03e5-4859-a09d-e4ae2961de7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:53.854750 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-313eaf98-03e5-4859-a09d-e4ae2961de7b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:53.855997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-313eaf98-03e5-4859-a09d-e4ae2961de7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:53.864323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:54.013014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57848c40-9164-4893-a6d5-3394e4948647 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:54.027395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57848c40-9164-4893-a6d5-3394e4948647 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:54.032748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099681b-b9cc-4058-96fa-05ca84d666dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:54.033371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099681b-b9cc-4058-96fa-05ca84d666dc service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:54.033648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099681b-b9cc-4058-96fa-05ca84d666dc service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:54.033920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099681b-b9cc-4058-96fa-05ca84d666dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:54.042365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099681b-b9cc-4058-96fa-05ca84d666dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:54.043959 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099681b-b9cc-4058-96fa-05ca84d666dc service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:54.053313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 708/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:55.358335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b8a06-5458-4729-9a54-db0288751e80 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:55.358868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b8a06-5458-4729-9a54-db0288751e80 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:55.358868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b8a06-5458-4729-9a54-db0288751e80 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:55.360704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:55.365765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c04d42-5228-4fca-9d8a-caf171afbe28 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:55.366204 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c04d42-5228-4fca-9d8a-caf171afbe28 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:55.366319 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c04d42-5228-4fca-9d8a-caf171afbe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:55.385089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-51c04d42-5228-4fca-9d8a-caf171afbe28 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:55.386277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-51c04d42-5228-4fca-9d8a-caf171afbe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:55.394644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:55.547989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b8a06-5458-4729-9a54-db0288751e80 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:55.562544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b8a06-5458-4729-9a54-db0288751e80 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:55.568487 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23d6e2-9821-46e4-bc49-4b982189ccfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:55.569128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23d6e2-9821-46e4-bc49-4b982189ccfa service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:55.569408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23d6e2-9821-46e4-bc49-4b982189ccfa service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:55.569682 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23d6e2-9821-46e4-bc49-4b982189ccfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:55.577718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23d6e2-9821-46e4-bc49-4b982189ccfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:55.579326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23d6e2-9821-46e4-bc49-4b982189ccfa service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:55.588447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 722/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:56.907741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a483f48-b560-4cc1-a759-747089ed5db0 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:56.908297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a483f48-b560-4cc1-a759-747089ed5db0 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:56.908297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a483f48-b560-4cc1-a759-747089ed5db0 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:56.910115 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:56.915348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028e5c4-988c-4882-8966-6daa321f1a18 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:56.915747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028e5c4-988c-4882-8966-6daa321f1a18 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:56.915963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028e5c4-988c-4882-8966-6daa321f1a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:56.934559 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-4028e5c4-988c-4882-8966-6daa321f1a18 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:56.935779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4028e5c4-988c-4882-8966-6daa321f1a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:56.944402 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:57.095713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a483f48-b560-4cc1-a759-747089ed5db0 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:57.110512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a483f48-b560-4cc1-a759-747089ed5db0 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:57.115949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba0ad7-f35d-4ef5-a920-651fc7400141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:57.116582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba0ad7-f35d-4ef5-a920-651fc7400141 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:57.116864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba0ad7-f35d-4ef5-a920-651fc7400141 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:57.117134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba0ad7-f35d-4ef5-a920-651fc7400141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:57.125383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba0ad7-f35d-4ef5-a920-651fc7400141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:57.126993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba0ad7-f35d-4ef5-a920-651fc7400141 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:57.138547 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 711/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:58.387675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6988e6f-106f-486e-96d7-ee33df6d8194 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:58.388203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6988e6f-106f-486e-96d7-ee33df6d8194 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:58.388318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6988e6f-106f-486e-96d7-ee33df6d8194 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:58.390031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:58.395492 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2790d8-fbcc-4168-ba46-7dd30dc9ead3 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:58.395918 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2790d8-fbcc-4168-ba46-7dd30dc9ead3 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:58.396043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2790d8-fbcc-4168-ba46-7dd30dc9ead3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:58.414998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-5d2790d8-fbcc-4168-ba46-7dd30dc9ead3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:58.416180 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5d2790d8-fbcc-4168-ba46-7dd30dc9ead3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:58.423904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:58.573050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6988e6f-106f-486e-96d7-ee33df6d8194 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:58.587594 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6988e6f-106f-486e-96d7-ee33df6d8194 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:58.592959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059573cb-00c3-46b1-9e4e-baa099cb2529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:58.593575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059573cb-00c3-46b1-9e4e-baa099cb2529 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:58.593850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059573cb-00c3-46b1-9e4e-baa099cb2529 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:58.594122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059573cb-00c3-46b1-9e4e-baa099cb2529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:58.602404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059573cb-00c3-46b1-9e4e-baa099cb2529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:58.603985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059573cb-00c3-46b1-9e4e-baa099cb2529 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:58.613347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 725/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:59.856862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e84faa-7c99-4b8a-bde3-1e2929194670 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:59.856862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e84faa-7c99-4b8a-bde3-1e2929194670 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:59.857375 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e84faa-7c99-4b8a-bde3-1e2929194670 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:59.858938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:59.864675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e5747-c9f6-4842-af29-be4391a411a5 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:59.865072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e5747-c9f6-4842-af29-be4391a411a5 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:59.865225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e5747-c9f6-4842-af29-be4391a411a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:59.884816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-302e5747-c9f6-4842-af29-be4391a411a5 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:59.886111 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-302e5747-c9f6-4842-af29-be4391a411a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:59.894043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:00.043638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e84faa-7c99-4b8a-bde3-1e2929194670 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:00.058468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e84faa-7c99-4b8a-bde3-1e2929194670 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:00.063992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c2449-93ec-4e74-bfa5-7cd3d4fc05f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:00.064651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c2449-93ec-4e74-bfa5-7cd3d4fc05f7 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:00.064943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c2449-93ec-4e74-bfa5-7cd3d4fc05f7 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:00.065248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c2449-93ec-4e74-bfa5-7cd3d4fc05f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:00.073991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c2449-93ec-4e74-bfa5-7cd3d4fc05f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:00.075687 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c2449-93ec-4e74-bfa5-7cd3d4fc05f7 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:00.086284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 714/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:01.344225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010fce-97a3-4f4e-8cc0-f333e9dc6df0 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.344757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010fce-97a3-4f4e-8cc0-f333e9dc6df0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.344757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010fce-97a3-4f4e-8cc0-f333e9dc6df0 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.346664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:01.351793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb599-4e37-4cd1-a02b-fda3679c7532 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.352218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb599-4e37-4cd1-a02b-fda3679c7532 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.352319 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb599-4e37-4cd1-a02b-fda3679c7532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.370378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-9e6cb599-4e37-4cd1-a02b-fda3679c7532 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:01.371591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9e6cb599-4e37-4cd1-a02b-fda3679c7532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:01.379709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:01.534950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010fce-97a3-4f4e-8cc0-f333e9dc6df0 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.548918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010fce-97a3-4f4e-8cc0-f333e9dc6df0 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:01.554795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871868ed-9838-437c-99ac-71723c57b7f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:01.555459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871868ed-9838-437c-99ac-71723c57b7f2 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.555739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871868ed-9838-437c-99ac-71723c57b7f2 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.556089 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871868ed-9838-437c-99ac-71723c57b7f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.563973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871868ed-9838-437c-99ac-71723c57b7f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:01.565631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871868ed-9838-437c-99ac-71723c57b7f2 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:01.575302 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 728/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:03.775635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df88f-b1e4-4880-8ad0-b90d6503836d None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.776171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df88f-b1e4-4880-8ad0-b90d6503836d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.776171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df88f-b1e4-4880-8ad0-b90d6503836d None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.777993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:03.783348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1886b-d467-4303-8440-2799bc4cd973 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.783760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1886b-d467-4303-8440-2799bc4cd973 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.783904 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1886b-d467-4303-8440-2799bc4cd973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.802544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2ae1886b-d467-4303-8440-2799bc4cd973 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:03.803800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2ae1886b-d467-4303-8440-2799bc4cd973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:03.811851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:03.850808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df88f-b1e4-4880-8ad0-b90d6503836d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:03.861390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df88f-b1e4-4880-8ad0-b90d6503836d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:03.865383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0312a6-1605-4e09-9450-63c47a23f8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:03.865998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0312a6-1605-4e09-9450-63c47a23f8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.866270 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0312a6-1605-4e09-9450-63c47a23f8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.866540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0312a6-1605-4e09-9450-63c47a23f8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.875069 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0312a6-1605-4e09-9450-63c47a23f8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:03.876467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0312a6-1605-4e09-9450-63c47a23f8c6 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:03.886256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 717/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:06.376166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6936f-bcac-4862-a6da-fab1e7133f43 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:06.376720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6936f-bcac-4862-a6da-fab1e7133f43 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:06.376720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6936f-bcac-4862-a6da-fab1e7133f43 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:06.378572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:06.384340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941262-19dd-4b58-963b-32b24e763cb7 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:06.384797 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941262-19dd-4b58-963b-32b24e763cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:06.385063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941262-19dd-4b58-963b-32b24e763cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:06.404055 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-74941262-19dd-4b58-963b-32b24e763cb7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:06.405611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-74941262-19dd-4b58-963b-32b24e763cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:06.415601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:06.453982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6936f-bcac-4862-a6da-fab1e7133f43 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:06.465039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6936f-bcac-4862-a6da-fab1e7133f43 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:06.468538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5efa7-1989-4979-a7f5-6d9608958253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:06.469174 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5efa7-1989-4979-a7f5-6d9608958253 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:06.469455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5efa7-1989-4979-a7f5-6d9608958253 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:06.469728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5efa7-1989-4979-a7f5-6d9608958253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:06.482601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5efa7-1989-4979-a7f5-6d9608958253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:06.484089 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5efa7-1989-4979-a7f5-6d9608958253 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:06.494488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 731/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:09.080808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798772a-5f27-401a-88bc-5ccfdf657b5d None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:09.081373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798772a-5f27-401a-88bc-5ccfdf657b5d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:09.081373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798772a-5f27-401a-88bc-5ccfdf657b5d None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:09.083337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:09.088604 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452fba5-0d6d-434c-9f4a-ead3394377c8 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:09.089009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452fba5-0d6d-434c-9f4a-ead3394377c8 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:09.089160 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452fba5-0d6d-434c-9f4a-ead3394377c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:09.106670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c452fba5-0d6d-434c-9f4a-ead3394377c8 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:09.107903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c452fba5-0d6d-434c-9f4a-ead3394377c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:09.116104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:09.155838 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798772a-5f27-401a-88bc-5ccfdf657b5d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:09.166201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798772a-5f27-401a-88bc-5ccfdf657b5d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:09.169667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af06a5-a2c0-4568-a16e-36d4765ad010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:09.170292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af06a5-a2c0-4568-a16e-36d4765ad010 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:09.170570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af06a5-a2c0-4568-a16e-36d4765ad010 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:09.170846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af06a5-a2c0-4568-a16e-36d4765ad010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:09.180450 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af06a5-a2c0-4568-a16e-36d4765ad010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:09.181861 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af06a5-a2c0-4568-a16e-36d4765ad010 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:09.191647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 720/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:11.585901 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561df4f-a319-410c-ac3f-b0f765da6b20 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.586479 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561df4f-a319-410c-ac3f-b0f765da6b20 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.586479 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561df4f-a319-410c-ac3f-b0f765da6b20 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.588288 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:32:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:11.593940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d652-72c2-48cb-911d-03f671c666dd None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.594408 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d652-72c2-48cb-911d-03f671c666dd None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.594513 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d652-72c2-48cb-911d-03f671c666dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.612988 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c741d652-72c2-48cb-911d-03f671c666dd None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:11.614162 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c741d652-72c2-48cb-911d-03f671c666dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:11.621917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:11.660595 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561df4f-a319-410c-ac3f-b0f765da6b20 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:11.670943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561df4f-a319-410c-ac3f-b0f765da6b20 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:11.674350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed1d91-fef9-4157-b9c5-a9bec113a6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:11.675010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed1d91-fef9-4157-b9c5-a9bec113a6da service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.675289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed1d91-fef9-4157-b9c5-a9bec113a6da service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.675560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed1d91-fef9-4157-b9c5-a9bec113a6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.684103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed1d91-fef9-4157-b9c5-a9bec113a6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:11.685511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed1d91-fef9-4157-b9c5-a9bec113a6da service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:11.695171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 734/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:14.012763 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f01bf-93c1-4e84-bc9e-a047ed1fd166 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:14.013553 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f01bf-93c1-4e84-bc9e-a047ed1fd166 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:14.013553 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f01bf-93c1-4e84-bc9e-a047ed1fd166 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:14.015081 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:14.020387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7730-93ed-463d-9a34-b680f72c46c1 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:14.020831 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7730-93ed-463d-9a34-b680f72c46c1 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:14.020946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7730-93ed-463d-9a34-b680f72c46c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:14.039202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f7aa7730-93ed-463d-9a34-b680f72c46c1 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:14.040388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f7aa7730-93ed-463d-9a34-b680f72c46c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:14.048263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:14.087202 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f01bf-93c1-4e84-bc9e-a047ed1fd166 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:14.098635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f01bf-93c1-4e84-bc9e-a047ed1fd166 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:14.102134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bb476-2783-42b3-883f-aeb2ea10ad87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:14.102762 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bb476-2783-42b3-883f-aeb2ea10ad87 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:14.103082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bb476-2783-42b3-883f-aeb2ea10ad87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:14.103359 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bb476-2783-42b3-883f-aeb2ea10ad87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:14.112114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bb476-2783-42b3-883f-aeb2ea10ad87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:14.113558 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bb476-2783-42b3-883f-aeb2ea10ad87 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:14.122675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 723/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:16.437166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58dc8-e6f5-4dfb-b62e-5ca7d9bd68f0 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:16.437776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58dc8-e6f5-4dfb-b62e-5ca7d9bd68f0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:16.437776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58dc8-e6f5-4dfb-b62e-5ca7d9bd68f0 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:16.439489 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:16.445285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ad7c0-e81f-4bcc-9769-f6052b924108 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:16.445763 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ad7c0-e81f-4bcc-9769-f6052b924108 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:16.445870 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ad7c0-e81f-4bcc-9769-f6052b924108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:16.463034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e36ad7c0-e81f-4bcc-9769-f6052b924108 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:16.464194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e36ad7c0-e81f-4bcc-9769-f6052b924108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:16.471776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:16.509538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d58dc8-e6f5-4dfb-b62e-5ca7d9bd68f0 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:16.520082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d58dc8-e6f5-4dfb-b62e-5ca7d9bd68f0 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:16.523568 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af71b64-0414-433f-9463-78d793276ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:16.524186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af71b64-0414-433f-9463-78d793276ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:16.524465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af71b64-0414-433f-9463-78d793276ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:16.524738 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af71b64-0414-433f-9463-78d793276ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:16.533338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af71b64-0414-433f-9463-78d793276ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:16.534731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af71b64-0414-433f-9463-78d793276ec6 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:16.543842 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 737/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:18.883229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f014a62-8574-4728-a04f-ac4e1de3a40f None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:18.883819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f014a62-8574-4728-a04f-ac4e1de3a40f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:18.883819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f014a62-8574-4728-a04f-ac4e1de3a40f None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:18.885614 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:18.890785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7caa68-a718-46fc-a8cd-9f6de366ad12 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:18.891243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7caa68-a718-46fc-a8cd-9f6de366ad12 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:18.891349 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7caa68-a718-46fc-a8cd-9f6de366ad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:18.909895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-3c7caa68-a718-46fc-a8cd-9f6de366ad12 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:18.911208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3c7caa68-a718-46fc-a8cd-9f6de366ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:18.918742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:18.956201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f014a62-8574-4728-a04f-ac4e1de3a40f None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:18.966635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f014a62-8574-4728-a04f-ac4e1de3a40f None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:18.970156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e799a35-e34d-4ca5-a2ac-1d564d26bc35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:18.970775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e799a35-e34d-4ca5-a2ac-1d564d26bc35 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:18.971089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e799a35-e34d-4ca5-a2ac-1d564d26bc35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:18.971867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e799a35-e34d-4ca5-a2ac-1d564d26bc35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:18.980494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e799a35-e34d-4ca5-a2ac-1d564d26bc35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:18.981941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e799a35-e34d-4ca5-a2ac-1d564d26bc35 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:18.991780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 726/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:21.300615 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b210a2-9708-49a2-afc4-5a39b9a55cea None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:21.301149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b210a2-9708-49a2-afc4-5a39b9a55cea None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:21.301149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b210a2-9708-49a2-afc4-5a39b9a55cea None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:21.302938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:21.308210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368338b-55c1-420d-8d14-5ef85cfcf00b None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:21.308755 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368338b-55c1-420d-8d14-5ef85cfcf00b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:21.308755 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368338b-55c1-420d-8d14-5ef85cfcf00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:21.331078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-b368338b-55c1-420d-8d14-5ef85cfcf00b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:21.332247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b368338b-55c1-420d-8d14-5ef85cfcf00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:21.339889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:21.377073 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b210a2-9708-49a2-afc4-5a39b9a55cea None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:21.388347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b210a2-9708-49a2-afc4-5a39b9a55cea None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:21.391803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cbfc-7361-498a-b72f-019e6ca09b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:21.392426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cbfc-7361-498a-b72f-019e6ca09b26 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:21.392708 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cbfc-7361-498a-b72f-019e6ca09b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:21.393657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cbfc-7361-498a-b72f-019e6ca09b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:21.402579 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7cbfc-7361-498a-b72f-019e6ca09b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:21.404163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7cbfc-7361-498a-b72f-019e6ca09b26 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:21.413869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 740/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:23.828269 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b7abc-8ed4-45a9-a1b9-fd51f840a0ae None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:23.828804 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b7abc-8ed4-45a9-a1b9-fd51f840a0ae None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:23.828804 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b7abc-8ed4-45a9-a1b9-fd51f840a0ae None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:23.831289 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:23.836452 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fce0b8-f578-4a93-b6e8-d6336a7d87c8 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:23.836863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fce0b8-f578-4a93-b6e8-d6336a7d87c8 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:23.837001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fce0b8-f578-4a93-b6e8-d6336a7d87c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:23.854019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-75fce0b8-f578-4a93-b6e8-d6336a7d87c8 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:23.855219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-75fce0b8-f578-4a93-b6e8-d6336a7d87c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:23.863648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:23.900506 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b7abc-8ed4-45a9-a1b9-fd51f840a0ae None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:23.911495 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b7abc-8ed4-45a9-a1b9-fd51f840a0ae None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:23.914955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57471472-4175-4efa-8692-e07de970e21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:23.915572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57471472-4175-4efa-8692-e07de970e21c service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:23.915847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57471472-4175-4efa-8692-e07de970e21c service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:23.916116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57471472-4175-4efa-8692-e07de970e21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:23.924702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57471472-4175-4efa-8692-e07de970e21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:23.926111 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57471472-4175-4efa-8692-e07de970e21c service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:23.935018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 729/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:26.215985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a828e-9c7e-4e7e-a367-e73649d7a6bc None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:26.216509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a828e-9c7e-4e7e-a367-e73649d7a6bc None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:26.216509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a828e-9c7e-4e7e-a367-e73649d7a6bc None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:26.218348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 742/1471] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:26.223572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69830ce8-4220-41b6-82a1-06957c0c97b5 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:26.224020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69830ce8-4220-41b6-82a1-06957c0c97b5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:26.224118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69830ce8-4220-41b6-82a1-06957c0c97b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:26.241742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-69830ce8-4220-41b6-82a1-06957c0c97b5 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:26.242925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-69830ce8-4220-41b6-82a1-06957c0c97b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:26.250420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 730/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:26.286449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a828e-9c7e-4e7e-a367-e73649d7a6bc None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:26.296781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a828e-9c7e-4e7e-a367-e73649d7a6bc None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:26.300737 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da814b-56b9-4305-843c-cc51c4330216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:26.301352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da814b-56b9-4305-843c-cc51c4330216 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:26.301628 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da814b-56b9-4305-843c-cc51c4330216 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:26.301899 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da814b-56b9-4305-843c-cc51c4330216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:26.310351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da814b-56b9-4305-843c-cc51c4330216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:26.311796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da814b-56b9-4305-843c-cc51c4330216 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:26.321425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 743/1473] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:46.870882 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d65380-c349-44b7-8773-99fce46ec3c1 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:46.871530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d65380-c349-44b7-8773-99fce46ec3c1 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:46.871530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d65380-c349-44b7-8773-99fce46ec3c1 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:46.873263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 731/1474] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:46.879015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea029-372c-459a-bd4d-22a3134fdd3a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:46.879474 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea029-372c-459a-bd4d-22a3134fdd3a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:46.879582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea029-372c-459a-bd4d-22a3134fdd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:46.897967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-0eeea029-372c-459a-bd4d-22a3134fdd3a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:46.899191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0eeea029-372c-459a-bd4d-22a3134fdd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:46.906844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 744/1475] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:46.952097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d277ab-e74b-404f-be42-d5e9d46e0ada None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:46.952376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d277ab-e74b-404f-be42-d5e9d46e0ada None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:46.952644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d277ab-e74b-404f-be42-d5e9d46e0ada None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:46.954384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 732/1476] 10.222.0.44 () {54 vars in 962 bytes} [Mon Feb 28 10:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:46.959668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b97b-1699-4aac-9d4f-178d28415e02 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:46.959985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b97b-1699-4aac-9d4f-178d28415e02 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:46.960265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b97b-1699-4aac-9d4f-178d28415e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:46.977830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6851b97b-1699-4aac-9d4f-178d28415e02 None None] MFA Rules not processed for user `80ad61a348b2450baceb030f98150647`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:46.979076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6851b97b-1699-4aac-9d4f-178d28415e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:46.985424 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 745/1477] 10.222.0.44 () {58 vars in 1059 bytes} [Mon Feb 28 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:46.992166 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d277ab-e74b-404f-be42-d5e9d46e0ada None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:47.002871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d277ab-e74b-404f-be42-d5e9d46e0ada None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:47.006258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a278e-0ec7-4d5e-aaf0-454720c3bcc1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ad61a348b2450baceb030f98150647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:47.006861 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a278e-0ec7-4d5e-aaf0-454720c3bcc1 service glance] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:47.007161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a278e-0ec7-4d5e-aaf0-454720c3bcc1 service glance] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:47.007431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a278e-0ec7-4d5e-aaf0-454720c3bcc1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:47.017173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a278e-0ec7-4d5e-aaf0-454720c3bcc1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:47.019543 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a278e-0ec7-4d5e-aaf0-454720c3bcc1 service glance] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:47.028905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 733/1478] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:32:49.399457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988b63-e04f-4f0f-aec7-2361efe25395 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:49.400014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988b63-e04f-4f0f-aec7-2361efe25395 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:49.400014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988b63-e04f-4f0f-aec7-2361efe25395 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:49.401828 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 746/1479] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:49.407116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185452f8-149b-499b-ba34-a27655416a58 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:49.407547 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185452f8-149b-499b-ba34-a27655416a58 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:49.407687 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185452f8-149b-499b-ba34-a27655416a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:49.425810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-185452f8-149b-499b-ba34-a27655416a58 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:49.427029 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-185452f8-149b-499b-ba34-a27655416a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:49.434721 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 734/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:49.457816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988b63-e04f-4f0f-aec7-2361efe25395 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:49.469987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988b63-e04f-4f0f-aec7-2361efe25395 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:49.475177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4906f-494e-4422-884e-daa11537ea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:49.475951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4906f-494e-4422-884e-daa11537ea8a admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:49.476230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4906f-494e-4422-884e-daa11537ea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:49.476503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4906f-494e-4422-884e-daa11537ea8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:49.477222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4906f-494e-4422-884e-daa11537ea8a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:49.478916 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING py.warnings [None req-55d4906f-494e-4422-884e-daa11537ea8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:32:49.478916 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: warnings.warn(msg) Feb 28 10:32:49.478916 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: Feb 28 10:32:49.480036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4906f-494e-4422-884e-daa11537ea8a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:49.499089 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 747/1481] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Feb 28 10:32:49 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:51.802728 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ae58-a120-4079-a71f-d5c93dbc145c None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.803332 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ae58-a120-4079-a71f-d5c93dbc145c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.803332 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ae58-a120-4079-a71f-d5c93dbc145c None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.805065 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 735/1482] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:51.810192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358053b-270d-4712-86a4-87074f111899 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.810630 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358053b-270d-4712-86a4-87074f111899 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.810776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358053b-270d-4712-86a4-87074f111899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.832942 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-d358053b-270d-4712-86a4-87074f111899 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:51.834620 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d358053b-270d-4712-86a4-87074f111899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:51.846521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 748/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:51.893048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6ae58-a120-4079-a71f-d5c93dbc145c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.906852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6ae58-a120-4079-a71f-d5c93dbc145c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.912806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fce89-243f-4149-84ce-1db226a0c42c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.913425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fce89-243f-4149-84ce-1db226a0c42c service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.913700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fce89-243f-4149-84ce-1db226a0c42c service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.913970 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fce89-243f-4149-84ce-1db226a0c42c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.921766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fce89-243f-4149-84ce-1db226a0c42c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.923344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fce89-243f-4149-84ce-1db226a0c42c service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.932266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 736/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:54.418873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa516d-4c71-453a-a071-a5364871b151 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.419423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa516d-4c71-453a-a071-a5364871b151 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.419539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa516d-4c71-453a-a071-a5364871b151 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.421268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 749/1485] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:54.426463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc196c-2285-4b22-a53f-d718c45318cd None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.426859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc196c-2285-4b22-a53f-d718c45318cd None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.427050 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc196c-2285-4b22-a53f-d718c45318cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.444874 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-47dc196c-2285-4b22-a53f-d718c45318cd None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:54.446079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-47dc196c-2285-4b22-a53f-d718c45318cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:54.453961 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 737/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:54.489558 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa516d-4c71-453a-a071-a5364871b151 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:54.499921 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa516d-4c71-453a-a071-a5364871b151 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:54.504104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cf83d-1ccf-49e3-9118-11d4e6394646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:54.504746 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf83d-1ccf-49e3-9118-11d4e6394646 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.505023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf83d-1ccf-49e3-9118-11d4e6394646 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.505293 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf83d-1ccf-49e3-9118-11d4e6394646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.514711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cf83d-1ccf-49e3-9118-11d4e6394646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:54.516169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cf83d-1ccf-49e3-9118-11d4e6394646 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:54.526000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 750/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:56.870069 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ab545-10cf-42d7-85e0-b780064c5a2a None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:56.870630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ab545-10cf-42d7-85e0-b780064c5a2a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:56.870630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ab545-10cf-42d7-85e0-b780064c5a2a None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:56.872428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 738/1488] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:56.878215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b488-5f37-4ccf-99a6-c1c8cbd6cc71 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:56.878631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b488-5f37-4ccf-99a6-c1c8cbd6cc71 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:56.878761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b488-5f37-4ccf-99a6-c1c8cbd6cc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:56.896261 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6097b488-5f37-4ccf-99a6-c1c8cbd6cc71 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:56.897426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6097b488-5f37-4ccf-99a6-c1c8cbd6cc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:56.904937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 751/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:56.942735 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ab545-10cf-42d7-85e0-b780064c5a2a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:56.953079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ab545-10cf-42d7-85e0-b780064c5a2a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:56.956601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b2bf-ff9f-4c20-932b-59e2bb3262b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:56.957219 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b2bf-ff9f-4c20-932b-59e2bb3262b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:56.957501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b2bf-ff9f-4c20-932b-59e2bb3262b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:56.957767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b2bf-ff9f-4c20-932b-59e2bb3262b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:56.966335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b2bf-ff9f-4c20-932b-59e2bb3262b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:56.967786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b2bf-ff9f-4c20-932b-59e2bb3262b4 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:56.976828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 739/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:59.364789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8b37-396f-489d-9d0b-f56f63f78804 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:59.365333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8b37-396f-489d-9d0b-f56f63f78804 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:59.365526 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8b37-396f-489d-9d0b-f56f63f78804 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:59.367219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 752/1491] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:59.372919 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959d42-fbb3-4955-8672-f58f701b15f9 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:59.373432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959d42-fbb3-4955-8672-f58f701b15f9 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:59.373556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959d42-fbb3-4955-8672-f58f701b15f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:59.391760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-61959d42-fbb3-4955-8672-f58f701b15f9 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:59.393438 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-61959d42-fbb3-4955-8672-f58f701b15f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:59.401020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 740/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:59.441177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c8b37-396f-489d-9d0b-f56f63f78804 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:59.451578 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c8b37-396f-489d-9d0b-f56f63f78804 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:59.455607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad87f0-4052-4c7a-8ee2-84bdc0991119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:59.456264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad87f0-4052-4c7a-8ee2-84bdc0991119 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:59.456538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad87f0-4052-4c7a-8ee2-84bdc0991119 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:59.456807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad87f0-4052-4c7a-8ee2-84bdc0991119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:59.465329 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad87f0-4052-4c7a-8ee2-84bdc0991119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:59.466740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad87f0-4052-4c7a-8ee2-84bdc0991119 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:59.476219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 753/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:01.972642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57c5b-2f4b-413c-960e-2f67fd7d8221 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:01.973207 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57c5b-2f4b-413c-960e-2f67fd7d8221 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:01.973207 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57c5b-2f4b-413c-960e-2f67fd7d8221 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:01.975040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 741/1494] 10.222.0.44 () {54 vars in 926 bytes} [Mon Feb 28 10:33:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:33:01.980425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a0be6-1c90-4642-91d5-18b37713630e None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:01.980853 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a0be6-1c90-4642-91d5-18b37713630e None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:01.980963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a0be6-1c90-4642-91d5-18b37713630e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:01.998203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-fb1a0be6-1c90-4642-91d5-18b37713630e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:01.999442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fb1a0be6-1c90-4642-91d5-18b37713630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:02.007561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 754/1495] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Feb 28 10:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:02.046702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a57c5b-2f4b-413c-960e-2f67fd7d8221 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:02.057382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a57c5b-2f4b-413c-960e-2f67fd7d8221 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:02.060789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a00f6-9e9b-4580-8b9a-3515c74e48da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:02.061407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a00f6-9e9b-4580-8b9a-3515c74e48da service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:02.061711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a00f6-9e9b-4580-8b9a-3515c74e48da service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:02.062092 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a00f6-9e9b-4580-8b9a-3515c74e48da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:02.071982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a00f6-9e9b-4580-8b9a-3515c74e48da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:02.073397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a00f6-9e9b-4580-8b9a-3515c74e48da service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:02.083397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 742/1496] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:21.331442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa473-4d69-49eb-8a7a-791d6b8d11c3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.332026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa473-4d69-49eb-8a7a-791d6b8d11c3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.332026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa473-4d69-49eb-8a7a-791d6b8d11c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.351182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-b14fa473-4d69-49eb-8a7a-791d6b8d11c3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:21.352355 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-b14fa473-4d69-49eb-8a7a-791d6b8d11c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:21.360598 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 755/1497] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:21.369603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880f94c-bbdd-4355-a0b3-c750f262eab1 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.370084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880f94c-bbdd-4355-a0b3-c750f262eab1 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.370199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880f94c-bbdd-4355-a0b3-c750f262eab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.387974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-f880f94c-bbdd-4355-a0b3-c750f262eab1 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:21.389133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f880f94c-bbdd-4355-a0b3-c750f262eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:21.396730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 743/1498] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:21.401099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa473-4d69-49eb-8a7a-791d6b8d11c3 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.410857 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa473-4d69-49eb-8a7a-791d6b8d11c3 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.415311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1079079-67b1-4e87-bf80-ee61276afa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.415945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1079079-67b1-4e87-bf80-ee61276afa65 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.416219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1079079-67b1-4e87-bf80-ee61276afa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.416491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1079079-67b1-4e87-bf80-ee61276afa65 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.417197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1079079-67b1-4e87-bf80-ee61276afa65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:34:21.417498 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1079079-67b1-4e87-bf80-ee61276afa65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.418497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING py.warnings [None req-b1079079-67b1-4e87-bf80-ee61276afa65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:34:21.418497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: warnings.warn(msg) Feb 28 10:34:21.418497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: Feb 28 10:34:21.419391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1079079-67b1-4e87-bf80-ee61276afa65 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.431062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 756/1499] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:34:21.438892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880f94c-bbdd-4355-a0b3-c750f262eab1 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.447636 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880f94c-bbdd-4355-a0b3-c750f262eab1 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.452136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a904b-3d31-4928-963b-9478997f7cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.452762 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a904b-3d31-4928-963b-9478997f7cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.453035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a904b-3d31-4928-963b-9478997f7cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.453301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a904b-3d31-4928-963b-9478997f7cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.453993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a904b-3d31-4928-963b-9478997f7cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.455025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING py.warnings [None req-073a904b-3d31-4928-963b-9478997f7cc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:34:21.455025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: warnings.warn(msg) Feb 28 10:34:21.455025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: Feb 28 10:34:21.456181 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a904b-3d31-4928-963b-9478997f7cc7 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.491574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 744/1500] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:34:21 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:34:21.495609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1079079-67b1-4e87-bf80-ee61276afa65 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.505293 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1079079-67b1-4e87-bf80-ee61276afa65 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.559495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd688244-1258-413b-8a1f-5f42ff0114a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.560147 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688244-1258-413b-8a1f-5f42ff0114a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.560425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688244-1258-413b-8a1f-5f42ff0114a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.560718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688244-1258-413b-8a1f-5f42ff0114a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.561387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd688244-1258-413b-8a1f-5f42ff0114a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.562388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING py.warnings [None req-bd688244-1258-413b-8a1f-5f42ff0114a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:34:21.562388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: warnings.warn(msg) Feb 28 10:34:21.562388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: Feb 28 10:34:21.563603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd688244-1258-413b-8a1f-5f42ff0114a9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.583834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 757/1501] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:34:21 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:21.587799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a904b-3d31-4928-963b-9478997f7cc7 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.598212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a904b-3d31-4928-963b-9478997f7cc7 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.602872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335a301-263b-4977-a946-dfc948e8d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.603493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335a301-263b-4977-a946-dfc948e8d91c admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.603767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335a301-263b-4977-a946-dfc948e8d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.604033 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335a301-263b-4977-a946-dfc948e8d91c admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.604737 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335a301-263b-4977-a946-dfc948e8d91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.605753 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING py.warnings [None req-6335a301-263b-4977-a946-dfc948e8d91c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:34:21.605753 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: warnings.warn(msg) Feb 28 10:34:21.605753 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: Feb 28 10:34:21.606598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335a301-263b-4977-a946-dfc948e8d91c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.620783 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 745/1502] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:21.624920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd688244-1258-413b-8a1f-5f42ff0114a9 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.634610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd688244-1258-413b-8a1f-5f42ff0114a9 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.638980 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4220d-9464-4ac1-87b2-0882c5e354f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.640132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4220d-9464-4ac1-87b2-0882c5e354f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.640405 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4220d-9464-4ac1-87b2-0882c5e354f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.640673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4220d-9464-4ac1-87b2-0882c5e354f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.641377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4220d-9464-4ac1-87b2-0882c5e354f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.642368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING py.warnings [None req-eea4220d-9464-4ac1-87b2-0882c5e354f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:34:21.642368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: warnings.warn(msg) Feb 28 10:34:21.642368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: Feb 28 10:34:21.643266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4220d-9464-4ac1-87b2-0882c5e354f3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.656647 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 758/1503] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:21.660484 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335a301-263b-4977-a946-dfc948e8d91c admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.669899 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335a301-263b-4977-a946-dfc948e8d91c admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.674634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6011a31-e86f-41c9-85e8-ce0361b3b546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.675514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6011a31-e86f-41c9-85e8-ce0361b3b546 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.675784 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6011a31-e86f-41c9-85e8-ce0361b3b546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.676046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6011a31-e86f-41c9-85e8-ce0361b3b546 admin admin] PATH_INFO: `/v3/projects/43cb5815ffe046d2ac8ab98f56f44e17/users/e8306d27c3d6498e80fbfc7e8b70e431/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.689577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6011a31-e86f-41c9-85e8-ce0361b3b546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43cb5815ffe046d2ac8ab98f56f44e17, user_id=e8306d27c3d6498e80fbfc7e8b70e431, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.690593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING py.warnings [None req-a6011a31-e86f-41c9-85e8-ce0361b3b546 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:34:21.690593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: warnings.warn(msg) Feb 28 10:34:21.690593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: Feb 28 10:34:21.692503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6011a31-e86f-41c9-85e8-ce0361b3b546 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.705485 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 746/1504] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:34:21 2022] PUT /identity/v3/projects/43cb5815ffe046d2ac8ab98f56f44e17/users/e8306d27c3d6498e80fbfc7e8b70e431/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:21.716439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e594392-ad59-47ed-a606-841a5f2054a4 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.716723 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e594392-ad59-47ed-a606-841a5f2054a4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.716991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e594392-ad59-47ed-a606-841a5f2054a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.742503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2e594392-ad59-47ed-a606-841a5f2054a4 None None] MFA Rules not processed for user `e8306d27c3d6498e80fbfc7e8b70e431`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:21.743706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2e594392-ad59-47ed-a606-841a5f2054a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:21.804048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 759/1505] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:34:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:34:21.814648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6011a31-e86f-41c9-85e8-ce0361b3b546 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.880412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6011a31-e86f-41c9-85e8-ce0361b3b546 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.885963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e52345-ee33-42d4-8a4a-224eb83c5267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.886595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e52345-ee33-42d4-8a4a-224eb83c5267 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.886874 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e52345-ee33-42d4-8a4a-224eb83c5267 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.887171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e52345-ee33-42d4-8a4a-224eb83c5267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.895180 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e52345-ee33-42d4-8a4a-224eb83c5267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.896799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e52345-ee33-42d4-8a4a-224eb83c5267 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.905892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 747/1506] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:21.974523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05250-41ce-4d3d-a9bf-a09cab388f70 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.974813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05250-41ce-4d3d-a9bf-a09cab388f70 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.975111 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05250-41ce-4d3d-a9bf-a09cab388f70 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.976781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 760/1507] 10.222.0.44 () {52 vars in 829 bytes} [Mon Feb 28 10:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:34:21.980475 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e52345-ee33-42d4-8a4a-224eb83c5267 service nova] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:22.041872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e52345-ee33-42d4-8a4a-224eb83c5267 service nova] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:22.046441 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:22.047314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:22.047591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:22.047860 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] PATH_INFO: `/v3/users/e8306d27c3d6498e80fbfc7e8b70e431` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:22.049055 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8306d27c3d6498e80fbfc7e8b70e431)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:22.050065 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING py.warnings [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:34:22.050065 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: warnings.warn(msg) Feb 28 10:34:22.050065 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: Feb 28 10:34:22.051284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:22.113471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8306d27c3d6498e80fbfc7e8b70e431'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.114096 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8306d27c3d6498e80fbfc7e8b70e431'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.131673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8306d27c3d6498e80fbfc7e8b70e431'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.141840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8306d27c3d6498e80fbfc7e8b70e431'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.153911 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8306d27c3d6498e80fbfc7e8b70e431'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.159734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 748/1508] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:34:21 2022] DELETE /identity/v3/users/e8306d27c3d6498e80fbfc7e8b70e431 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:22.164055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d20e5-56eb-41ed-a499-339f16bca13f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:22.164339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d20e5-56eb-41ed-a499-339f16bca13f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:22.164610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d20e5-56eb-41ed-a499-339f16bca13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:22.181451 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c43d20e5-56eb-41ed-a499-339f16bca13f None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:22.182619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c43d20e5-56eb-41ed-a499-339f16bca13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:22.237974 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 761/1509] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:34:22.247940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:22.249820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:22.304140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60578c23-593b-403b-b93c-d2b4225c8970 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:22.307764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b786-a11c-4fe0-aad2-cc7f1693a527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:22.308394 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b786-a11c-4fe0-aad2-cc7f1693a527 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:22.308697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b786-a11c-4fe0-aad2-cc7f1693a527 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:22.308964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b786-a11c-4fe0-aad2-cc7f1693a527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:22.318544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50b786-a11c-4fe0-aad2-cc7f1693a527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:22.320002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50b786-a11c-4fe0-aad2-cc7f1693a527 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:22.329260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 749/1510] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:22.640048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d20e5-56eb-41ed-a499-339f16bca13f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:22.641477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c43d20e5-56eb-41ed-a499-339f16bca13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:22.653189 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d20e5-56eb-41ed-a499-339f16bca13f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:22.659493 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:22.660337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:22.660613 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:22.660885 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] PATH_INFO: `/v3/projects/43cb5815ffe046d2ac8ab98f56f44e17` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:22.662606 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43cb5815ffe046d2ac8ab98f56f44e17)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:22.663889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING py.warnings [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:34:22.663889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: warnings.warn(msg) Feb 28 10:34:22.663889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: Feb 28 10:34:22.665135 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:22.724430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43cb5815ffe046d2ac8ab98f56f44e17', 'request_id': 'req-26f926ef-ce79-4522-bcb5-3fb30cf4b160'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.730110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43cb5815ffe046d2ac8ab98f56f44e17', 'request_id': 'req-26f926ef-ce79-4522-bcb5-3fb30cf4b160'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.743537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43cb5815ffe046d2ac8ab98f56f44e17', 'request_id': 'req-26f926ef-ce79-4522-bcb5-3fb30cf4b160'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.757061 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] The token cache is being invalidate because project 43cb5815ffe046d2ac8ab98f56f44e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:34:22.757346 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.758355 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26f926ef-ce79-4522-bcb5-3fb30cf4b160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.760045 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 762/1511] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:34:22 2022] DELETE /identity/v3/projects/43cb5815ffe046d2ac8ab98f56f44e17 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:58.486035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18152ec-1977-4e26-a2f5-40b8c2c46f49 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:58.486609 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18152ec-1977-4e26-a2f5-40b8c2c46f49 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:58.486609 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18152ec-1977-4e26-a2f5-40b8c2c46f49 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:58.488398 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 750/1512] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:35:58.493412 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343cdcd-084d-4b1c-8008-f312c9bb1867 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:58.493886 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343cdcd-084d-4b1c-8008-f312c9bb1867 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:58.494087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343cdcd-084d-4b1c-8008-f312c9bb1867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:58.513741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e343cdcd-084d-4b1c-8008-f312c9bb1867 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:58.515002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e343cdcd-084d-4b1c-8008-f312c9bb1867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:58.569948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 763/1513] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:58.720917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18152ec-1977-4e26-a2f5-40b8c2c46f49 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:58.722502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a18152ec-1977-4e26-a2f5-40b8c2c46f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:58.792313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18152ec-1977-4e26-a2f5-40b8c2c46f49 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:58.797718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6121442-1a48-4dd7-a671-0ff9ad5adf6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:58.798342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6121442-1a48-4dd7-a671-0ff9ad5adf6a service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:58.798618 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6121442-1a48-4dd7-a671-0ff9ad5adf6a service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:58.798889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6121442-1a48-4dd7-a671-0ff9ad5adf6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:58.806702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6121442-1a48-4dd7-a671-0ff9ad5adf6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:58.808301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6121442-1a48-4dd7-a671-0ff9ad5adf6a service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:58.817842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 751/1514] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:35:59.238146 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058fa16-5fef-4c49-9554-bacc9b297313 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:59.238433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058fa16-5fef-4c49-9554-bacc9b297313 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:59.238711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058fa16-5fef-4c49-9554-bacc9b297313 None None] PATH_INFO: `/v3` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:59.240037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 764/1515] 10.222.0.46 () {54 vars in 925 bytes} [Mon Feb 28 10:35:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:35:59.248214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09bf51-15bd-4d26-bd26-7dac08628c74 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:59.248570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09bf51-15bd-4d26-bd26-7dac08628c74 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:59.248913 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09bf51-15bd-4d26-bd26-7dac08628c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:59.266788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ad09bf51-15bd-4d26-bd26-7dac08628c74 None None] MFA Rules not processed for user `ee30c8013ebb40a99d1eac7820d7f1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:59.268017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ad09bf51-15bd-4d26-bd26-7dac08628c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:59.336581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 752/1516] 10.222.0.46 () {58 vars in 1015 bytes} [Mon Feb 28 10:35:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:00.120851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a9345-fe1e-4843-ada2-334e37dea4e2 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:00.121277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a9345-fe1e-4843-ada2-334e37dea4e2 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:00.121386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a9345-fe1e-4843-ada2-334e37dea4e2 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:00.123648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 765/1517] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:36:00.128393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485d00c-dc5d-43fb-b299-9ab68ef270e4 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:00.128917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485d00c-dc5d-43fb-b299-9ab68ef270e4 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:00.128917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485d00c-dc5d-43fb-b299-9ab68ef270e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:00.147352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-d485d00c-dc5d-43fb-b299-9ab68ef270e4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:00.148715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d485d00c-dc5d-43fb-b299-9ab68ef270e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:00.156380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 753/1518] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:00.309334 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a9345-fe1e-4843-ada2-334e37dea4e2 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:00.323376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a9345-fe1e-4843-ada2-334e37dea4e2 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:00.328754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17893cae-9a49-4106-89e4-efbae3db328e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:00.329382 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893cae-9a49-4106-89e4-efbae3db328e service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:00.329662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893cae-9a49-4106-89e4-efbae3db328e service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:00.329936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893cae-9a49-4106-89e4-efbae3db328e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:00.337861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17893cae-9a49-4106-89e4-efbae3db328e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:00.339491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17893cae-9a49-4106-89e4-efbae3db328e service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:00.349731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 766/1519] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:08.685069 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16614cd-36c6-4b45-a29a-08d6604f1a15 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:08.685600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16614cd-36c6-4b45-a29a-08d6604f1a15 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:08.685600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16614cd-36c6-4b45-a29a-08d6604f1a15 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:08.687354 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 754/1520] 10.222.0.44 () {54 vars in 960 bytes} [Mon Feb 28 10:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:36:08.692399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979a3a-453b-47d5-bad3-9c7ceb97bf88 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:08.692838 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979a3a-453b-47d5-bad3-9c7ceb97bf88 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:08.692933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979a3a-453b-47d5-bad3-9c7ceb97bf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:08.712693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-61979a3a-453b-47d5-bad3-9c7ceb97bf88 None None] MFA Rules not processed for user `ee30c8013ebb40a99d1eac7820d7f1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:08.713885 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-61979a3a-453b-47d5-bad3-9c7ceb97bf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:08.722929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 767/1521] 10.222.0.44 () {58 vars in 1057 bytes} [Mon Feb 28 10:36:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:08.730266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16614cd-36c6-4b45-a29a-08d6604f1a15 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:08.743491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16614cd-36c6-4b45-a29a-08d6604f1a15 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:08.748273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57daa28d-6049-48bc-9b3e-480e38b9b2f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee30c8013ebb40a99d1eac7820d7f1f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:08.748890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daa28d-6049-48bc-9b3e-480e38b9b2f2 service placement] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:08.749166 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daa28d-6049-48bc-9b3e-480e38b9b2f2 service placement] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:08.749438 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daa28d-6049-48bc-9b3e-480e38b9b2f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:08.757815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57daa28d-6049-48bc-9b3e-480e38b9b2f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:08.759420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57daa28d-6049-48bc-9b3e-480e38b9b2f2 service placement] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:08.769177 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 755/1522] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:12.029882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbf68c-7eab-46b2-94b6-9e075acbe852 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:12.030467 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbf68c-7eab-46b2-94b6-9e075acbe852 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:12.030467 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbf68c-7eab-46b2-94b6-9e075acbe852 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:12.032531 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 768/1523] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:36:12.038836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b42ea-f6c4-400c-891e-188dfc62e6f3 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:12.039375 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b42ea-f6c4-400c-891e-188dfc62e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:12.039652 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b42ea-f6c4-400c-891e-188dfc62e6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:12.060868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-5a9b42ea-f6c4-400c-891e-188dfc62e6f3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:12.062056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5a9b42ea-f6c4-400c-891e-188dfc62e6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:12.070216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 756/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:12.221892 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbf68c-7eab-46b2-94b6-9e075acbe852 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:12.237891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbf68c-7eab-46b2-94b6-9e075acbe852 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:12.243235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e8f71-a552-49ff-a2e6-547d5c11e5cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:12.243857 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e8f71-a552-49ff-a2e6-547d5c11e5cc service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:12.244131 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e8f71-a552-49ff-a2e6-547d5c11e5cc service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:12.244401 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e8f71-a552-49ff-a2e6-547d5c11e5cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:12.253018 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e8f71-a552-49ff-a2e6-547d5c11e5cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:12.254569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e8f71-a552-49ff-a2e6-547d5c11e5cc service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:12.263915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 769/1525] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:13.523676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994223b-3273-4942-bd3a-73ef2106b3e4 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:13.524252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994223b-3273-4942-bd3a-73ef2106b3e4 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:13.524252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994223b-3273-4942-bd3a-73ef2106b3e4 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:13.525975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 757/1526] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:36:13.531012 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346377-01c2-46cf-be93-6c6942f88e9b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:13.531408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346377-01c2-46cf-be93-6c6942f88e9b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:13.531562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346377-01c2-46cf-be93-6c6942f88e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:13.550739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-5d346377-01c2-46cf-be93-6c6942f88e9b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:13.551967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5d346377-01c2-46cf-be93-6c6942f88e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:13.559874 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 770/1527] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:13.714624 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994223b-3273-4942-bd3a-73ef2106b3e4 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:13.729110 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994223b-3273-4942-bd3a-73ef2106b3e4 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:13.734418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf705d-9dfd-4e33-9222-2da03ce3f866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:13.735180 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf705d-9dfd-4e33-9222-2da03ce3f866 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:13.735455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf705d-9dfd-4e33-9222-2da03ce3f866 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:13.736351 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf705d-9dfd-4e33-9222-2da03ce3f866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:13.744163 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf705d-9dfd-4e33-9222-2da03ce3f866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:13.745756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf705d-9dfd-4e33-9222-2da03ce3f866 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:13.754760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 758/1528] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:17.891522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37616-28c8-479a-8ec9-13bd174308d3 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:17.892144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37616-28c8-479a-8ec9-13bd174308d3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:17.892144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37616-28c8-479a-8ec9-13bd174308d3 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:17.893821 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 771/1529] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:36:17.899554 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a0039-11b4-4b95-9946-6ff39526c2a7 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:17.899983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a0039-11b4-4b95-9946-6ff39526c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:17.900098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a0039-11b4-4b95-9946-6ff39526c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:17.918131 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-f66a0039-11b4-4b95-9946-6ff39526c2a7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:17.919329 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f66a0039-11b4-4b95-9946-6ff39526c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:17.927668 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 759/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:17.962971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a37616-28c8-479a-8ec9-13bd174308d3 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:17.964671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-72a37616-28c8-479a-8ec9-13bd174308d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:18.019996 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a37616-28c8-479a-8ec9-13bd174308d3 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:18.023410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f1d66-d215-4b95-8f13-00b93a1be114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:18.024052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1d66-d215-4b95-8f13-00b93a1be114 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:18.024310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1d66-d215-4b95-8f13-00b93a1be114 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:18.024580 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1d66-d215-4b95-8f13-00b93a1be114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:18.034125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f1d66-d215-4b95-8f13-00b93a1be114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:18.036124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f1d66-d215-4b95-8f13-00b93a1be114 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:18.046202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 772/1531] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:20.329742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25d9a-3f2e-4e41-82a6-46358f02672e None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:20.330362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25d9a-3f2e-4e41-82a6-46358f02672e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:20.330473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25d9a-3f2e-4e41-82a6-46358f02672e None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:20.332232 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 760/1532] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:36:20.337721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5ae04-215c-4c2a-beec-fff4db60aef6 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:20.338165 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5ae04-215c-4c2a-beec-fff4db60aef6 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:20.338276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5ae04-215c-4c2a-beec-fff4db60aef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:20.356338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-68c5ae04-215c-4c2a-beec-fff4db60aef6 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:20.357516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-68c5ae04-215c-4c2a-beec-fff4db60aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:20.365883 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 773/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:20.401313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca25d9a-3f2e-4e41-82a6-46358f02672e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:20.412412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca25d9a-3f2e-4e41-82a6-46358f02672e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:20.415936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb698d1-bf89-4cdd-9861-18bd43249f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:20.416563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb698d1-bf89-4cdd-9861-18bd43249f98 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:20.416842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb698d1-bf89-4cdd-9861-18bd43249f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:20.417142 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb698d1-bf89-4cdd-9861-18bd43249f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:20.426516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb698d1-bf89-4cdd-9861-18bd43249f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:20.427984 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb698d1-bf89-4cdd-9861-18bd43249f98 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:20.437201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 761/1534] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:24.353164 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6b333-00be-4821-974f-092014ea9446 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:24.353706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6b333-00be-4821-974f-092014ea9446 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:24.353706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6b333-00be-4821-974f-092014ea9446 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:24.355522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 774/1535] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:36:24.361271 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59634489-f41e-4ad0-8dd3-57e10212b3eb None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:24.361673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59634489-f41e-4ad0-8dd3-57e10212b3eb None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:24.361810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59634489-f41e-4ad0-8dd3-57e10212b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:24.379965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-59634489-f41e-4ad0-8dd3-57e10212b3eb None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:24.381138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-59634489-f41e-4ad0-8dd3-57e10212b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:24.389030 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 762/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:24.643321 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6b333-00be-4821-974f-092014ea9446 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:24.644985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5eb6b333-00be-4821-974f-092014ea9446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:24.702028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6b333-00be-4821-974f-092014ea9446 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:24.705612 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f4499-2722-42e1-bb87-aa7e43775a79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:24.706246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f4499-2722-42e1-bb87-aa7e43775a79 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:24.706527 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f4499-2722-42e1-bb87-aa7e43775a79 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:24.706800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f4499-2722-42e1-bb87-aa7e43775a79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:24.715658 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f4499-2722-42e1-bb87-aa7e43775a79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:24.717107 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f4499-2722-42e1-bb87-aa7e43775a79 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:24.726715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 775/1537] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:27.031541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362aab2-d53f-47aa-ab00-498390c80263 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:27.032121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362aab2-d53f-47aa-ab00-498390c80263 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:27.032121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362aab2-d53f-47aa-ab00-498390c80263 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:27.033918 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 763/1538] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:36:27.039130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1166-6700-4207-a86b-741cea7c4230 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:27.039576 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1166-6700-4207-a86b-741cea7c4230 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:27.039684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1166-6700-4207-a86b-741cea7c4230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:27.057455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-4eac1166-6700-4207-a86b-741cea7c4230 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:27.058657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4eac1166-6700-4207-a86b-741cea7c4230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:27.066806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 776/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:27.318836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff97d-766c-4a53-90af-d31729177a4e None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:27.319145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff97d-766c-4a53-90af-d31729177a4e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:27.319417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff97d-766c-4a53-90af-d31729177a4e None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:27.321175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 764/1540] 10.222.0.44 () {54 vars in 963 bytes} [Mon Feb 28 10:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:36:27.326157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837ca12-837b-45b0-9ca0-2d38dd3897ca None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:27.326444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837ca12-837b-45b0-9ca0-2d38dd3897ca None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:27.326715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837ca12-837b-45b0-9ca0-2d38dd3897ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:27.346076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-d837ca12-837b-45b0-9ca0-2d38dd3897ca None None] MFA Rules not processed for user `e1c59b4bb1774e1badd132071859f503`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:27.347328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d837ca12-837b-45b0-9ca0-2d38dd3897ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:27.353669 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 777/1541] 10.222.0.44 () {58 vars in 1060 bytes} [Mon Feb 28 10:36:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:27.360915 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff97d-766c-4a53-90af-d31729177a4e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:27.371120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff97d-766c-4a53-90af-d31729177a4e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:27.374537 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904a299-81b3-4db0-bc70-b09129009107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:27.375182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a299-81b3-4db0-bc70-b09129009107 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:27.375460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a299-81b3-4db0-bc70-b09129009107 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:27.375758 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a299-81b3-4db0-bc70-b09129009107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:27.384520 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904a299-81b3-4db0-bc70-b09129009107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:27.385937 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904a299-81b3-4db0-bc70-b09129009107 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:27.395454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 765/1542] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:37:56.746881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986166e9-244e-49fd-b1d8-7bafe5fe20aa None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:56.748084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986166e9-244e-49fd-b1d8-7bafe5fe20aa None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:56.748210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986166e9-244e-49fd-b1d8-7bafe5fe20aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:56.784843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-986166e9-244e-49fd-b1d8-7bafe5fe20aa None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:56.786051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-986166e9-244e-49fd-b1d8-7bafe5fe20aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:56.806388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 778/1543] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:56.816552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7d7b-2ea6-404b-8bb8-f009b3f2726d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:56.817101 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7d7b-2ea6-404b-8bb8-f009b3f2726d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:56.817301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7d7b-2ea6-404b-8bb8-f009b3f2726d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:56.853210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e41b7d7b-2ea6-404b-8bb8-f009b3f2726d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:56.854429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e41b7d7b-2ea6-404b-8bb8-f009b3f2726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:56.873667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 766/1544] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:56.879187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986166e9-244e-49fd-b1d8-7bafe5fe20aa None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:56.909128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986166e9-244e-49fd-b1d8-7bafe5fe20aa None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:56.927808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd281e-a5eb-4ed3-b337-3b8f11d8addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:56.928165 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a72e-8fb6-4809-95f8-fdcbfd67e150 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:56.928442 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a72e-8fb6-4809-95f8-fdcbfd67e150 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:56.928714 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a72e-8fb6-4809-95f8-fdcbfd67e150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:56.929461 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd281e-a5eb-4ed3-b337-3b8f11d8addd admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:56.930041 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd281e-a5eb-4ed3-b337-3b8f11d8addd admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:56.930530 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd281e-a5eb-4ed3-b337-3b8f11d8addd admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:56.931494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd281e-a5eb-4ed3-b337-3b8f11d8addd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:37:56.932080 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd281e-a5eb-4ed3-b337-3b8f11d8addd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:56.933882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd281e-a5eb-4ed3-b337-3b8f11d8addd admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:56.961016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c120a72e-8fb6-4809-95f8-fdcbfd67e150 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:56.962473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c120a72e-8fb6-4809-95f8-fdcbfd67e150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:56.966056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 779/1545] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:37:56.973179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd281e-a5eb-4ed3-b337-3b8f11d8addd admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:56.987677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 767/1546] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:56.989382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ddee1-a201-4538-a34d-28ca3b6ceeed None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:56.989819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ddee1-a201-4538-a34d-28ca3b6ceeed None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:56.990246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ddee1-a201-4538-a34d-28ca3b6ceeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:56.994933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd281e-a5eb-4ed3-b337-3b8f11d8addd admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.012791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8712-bc32-4251-8184-3ef76e145d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.014217 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8712-bc32-4251-8184-3ef76e145d5e admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.014705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8712-bc32-4251-8184-3ef76e145d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.015028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8712-bc32-4251-8184-3ef76e145d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.015882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def8712-bc32-4251-8184-3ef76e145d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.017735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING py.warnings [None req-4def8712-bc32-4251-8184-3ef76e145d5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:37:57.017735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: warnings.warn(msg) Feb 28 10:37:57.017735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: Feb 28 10:37:57.019909 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-7e7ddee1-a201-4538-a34d-28ca3b6ceeed None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.021508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7e7ddee1-a201-4538-a34d-28ca3b6ceeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.027005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def8712-bc32-4251-8184-3ef76e145d5e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.054007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 768/1547] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.055857 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d5888-40a0-4a78-988b-f62056334b99 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.056491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d5888-40a0-4a78-988b-f62056334b99 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.056983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d5888-40a0-4a78-988b-f62056334b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.090999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ac5d5888-40a0-4a78-988b-f62056334b99 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.093201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ac5d5888-40a0-4a78-988b-f62056334b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.121549 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 780/1548] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:37:56 2022] POST /identity/v3/projects => generated 357 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:57.123815 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a0cd6-0267-4b3c-89c4-2e7772898c0b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.124237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 769/1549] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.131869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a0cd6-0267-4b3c-89c4-2e7772898c0b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.132614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a0cd6-0267-4b3c-89c4-2e7772898c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.132821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d5888-40a0-4a78-988b-f62056334b99 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.153427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d5888-40a0-4a78-988b-f62056334b99 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.194650 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e96a0cd6-0267-4b3c-89c4-2e7772898c0b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.199082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e96a0cd6-0267-4b3c-89c4-2e7772898c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.294558 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 781/1550] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.295865 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a0cd6-0267-4b3c-89c4-2e7772898c0b None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.302677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de60c46-6eba-4008-9dbb-85c1a312d840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.304044 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de60c46-6eba-4008-9dbb-85c1a312d840 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.305163 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de60c46-6eba-4008-9dbb-85c1a312d840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.305494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a0cd6-0267-4b3c-89c4-2e7772898c0b None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.306245 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de60c46-6eba-4008-9dbb-85c1a312d840 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.308789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de60c46-6eba-4008-9dbb-85c1a312d840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.310046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING py.warnings [None req-3de60c46-6eba-4008-9dbb-85c1a312d840 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:37:57.310046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: warnings.warn(msg) Feb 28 10:37:57.310046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: Feb 28 10:37:57.311620 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805209d3-4347-436a-ac02-ea55144fa6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.312286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805209d3-4347-436a-ac02-ea55144fa6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.312571 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805209d3-4347-436a-ac02-ea55144fa6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.312849 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805209d3-4347-436a-ac02-ea55144fa6e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.312953 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de60c46-6eba-4008-9dbb-85c1a312d840 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.318381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805209d3-4347-436a-ac02-ea55144fa6e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:37:57.318381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805209d3-4347-436a-ac02-ea55144fa6e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.318381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805209d3-4347-436a-ac02-ea55144fa6e7 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.328985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 782/1551] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:37:57.330372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6f135-8c8a-4b5c-a3c0-91105c9556ca None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.330671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6f135-8c8a-4b5c-a3c0-91105c9556ca None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.331167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6f135-8c8a-4b5c-a3c0-91105c9556ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.346752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 770/1552] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/users => generated 279 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:57.346752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9d035-8d16-4ad0-8251-a2e4dcf15dc2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.346752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9d035-8d16-4ad0-8251-a2e4dcf15dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.346752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9d035-8d16-4ad0-8251-a2e4dcf15dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.350500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6ae6f135-8c8a-4b5c-a3c0-91105c9556ca None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.351855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6ae6f135-8c8a-4b5c-a3c0-91105c9556ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.360086 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 783/1553] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.367280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049b39b-1381-4309-95cd-c4db1a89b5e7 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.367280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049b39b-1381-4309-95cd-c4db1a89b5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.367280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049b39b-1381-4309-95cd-c4db1a89b5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.371717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-f6a9d035-8d16-4ad0-8251-a2e4dcf15dc2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.373454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f6a9d035-8d16-4ad0-8251-a2e4dcf15dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.381409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f049b39b-1381-4309-95cd-c4db1a89b5e7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.382838 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f049b39b-1381-4309-95cd-c4db1a89b5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.386823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 771/1554] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.394945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96060b-adf9-442a-b8c2-ecc0a3725f67 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.394945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96060b-adf9-442a-b8c2-ecc0a3725f67 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.394945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96060b-adf9-442a-b8c2-ecc0a3725f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.401085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 784/1555] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.404251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049b39b-1381-4309-95cd-c4db1a89b5e7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.418541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049b39b-1381-4309-95cd-c4db1a89b5e7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.419046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-3f96060b-adf9-442a-b8c2-ecc0a3725f67 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.426216 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e983244-1612-4dcc-915c-59d748cd59c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.427369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e983244-1612-4dcc-915c-59d748cd59c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.428066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e983244-1612-4dcc-915c-59d748cd59c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.428190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3f96060b-adf9-442a-b8c2-ecc0a3725f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.428699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e983244-1612-4dcc-915c-59d748cd59c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.429747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e983244-1612-4dcc-915c-59d748cd59c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:37:57.429989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e983244-1612-4dcc-915c-59d748cd59c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.432020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e983244-1612-4dcc-915c-59d748cd59c8 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.442837 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 772/1556] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.444355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2a4b1-1750-489f-b097-f5b7505d3393 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.444617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2a4b1-1750-489f-b097-f5b7505d3393 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.444890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2a4b1-1750-489f-b097-f5b7505d3393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.446965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 785/1557] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:37:57.447432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e983244-1612-4dcc-915c-59d748cd59c8 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.464446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e983244-1612-4dcc-915c-59d748cd59c8 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.466481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-5ad2a4b1-1750-489f-b097-f5b7505d3393 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.467851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5ad2a4b1-1750-489f-b097-f5b7505d3393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.469079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbfd13-2481-498e-a07e-267d415e9e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.469719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbfd13-2481-498e-a07e-267d415e9e32 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.469994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbfd13-2481-498e-a07e-267d415e9e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.470265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbfd13-2481-498e-a07e-267d415e9e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.470978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbfd13-2481-498e-a07e-267d415e9e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.472845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbfd13-2481-498e-a07e-267d415e9e32 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.475726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 773/1558] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.479061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2a4b1-1750-489f-b097-f5b7505d3393 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.486000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2a4b1-1750-489f-b097-f5b7505d3393 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.491708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8fff4-8273-4f40-bfd4-5006aa74f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.492599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8fff4-8273-4f40-bfd4-5006aa74f143 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.492886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8fff4-8273-4f40-bfd4-5006aa74f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.493176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8fff4-8273-4f40-bfd4-5006aa74f143 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.493891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8fff4-8273-4f40-bfd4-5006aa74f143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.495577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8fff4-8273-4f40-bfd4-5006aa74f143 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.503561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 786/1559] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:57.503561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b825b-b0e3-481d-93bf-24f8da473c2f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.503561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b825b-b0e3-481d-93bf-24f8da473c2f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.503561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b825b-b0e3-481d-93bf-24f8da473c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.506630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 774/1560] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:57.508333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e815468-d668-43d7-979d-21bcf0517e92 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.508616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e815468-d668-43d7-979d-21bcf0517e92 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.508888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e815468-d668-43d7-979d-21bcf0517e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.521564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-479b825b-b0e3-481d-93bf-24f8da473c2f None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.522889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-479b825b-b0e3-481d-93bf-24f8da473c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.526827 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-3e815468-d668-43d7-979d-21bcf0517e92 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.527997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3e815468-d668-43d7-979d-21bcf0517e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.579742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 787/1561] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.580952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac8e0-a65f-4ea4-b4f9-928d2f380639 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.581240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac8e0-a65f-4ea4-b4f9-928d2f380639 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.581516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac8e0-a65f-4ea4-b4f9-928d2f380639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.583581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 775/1562] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.584863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede795cf-d02e-4f02-9ba1-c665c65cb052 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.585138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede795cf-d02e-4f02-9ba1-c665c65cb052 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.585404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede795cf-d02e-4f02-9ba1-c665c65cb052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.602657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-516ac8e0-a65f-4ea4-b4f9-928d2f380639 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.603163 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ede795cf-d02e-4f02-9ba1-c665c65cb052 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.603883 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-516ac8e0-a65f-4ea4-b4f9-928d2f380639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.604357 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ede795cf-d02e-4f02-9ba1-c665c65cb052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.611563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 788/1563] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.615494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 776/1564] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.615602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ac8e0-a65f-4ea4-b4f9-928d2f380639 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.615683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff5722-6e12-4116-a3b5-33ff3545fdd1 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.615683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff5722-6e12-4116-a3b5-33ff3545fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.615683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff5722-6e12-4116-a3b5-33ff3545fdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.621193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ac8e0-a65f-4ea4-b4f9-928d2f380639 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.626163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1041244-e2f3-41fc-a26d-2e8d84f09106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.626791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1041244-e2f3-41fc-a26d-2e8d84f09106 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.627091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1041244-e2f3-41fc-a26d-2e8d84f09106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.627364 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1041244-e2f3-41fc-a26d-2e8d84f09106 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.628040 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1041244-e2f3-41fc-a26d-2e8d84f09106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.629924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1041244-e2f3-41fc-a26d-2e8d84f09106 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.632419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-76ff5722-6e12-4116-a3b5-33ff3545fdd1 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:57.633570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-76ff5722-6e12-4116-a3b5-33ff3545fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:57.641724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 777/1565] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:57.642451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff5722-6e12-4116-a3b5-33ff3545fdd1 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.651791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff5722-6e12-4116-a3b5-33ff3545fdd1 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.655114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 789/1566] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:57.655922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1041244-e2f3-41fc-a26d-2e8d84f09106 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.659578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0038340-d7ca-4186-a732-629ac4793986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.660223 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0038340-d7ca-4186-a732-629ac4793986 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.660498 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0038340-d7ca-4186-a732-629ac4793986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.660819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0038340-d7ca-4186-a732-629ac4793986 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.661497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0038340-d7ca-4186-a732-629ac4793986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.663429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0038340-d7ca-4186-a732-629ac4793986 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.684154 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 778/1567] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:57.685013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0038340-d7ca-4186-a732-629ac4793986 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.694843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0038340-d7ca-4186-a732-629ac4793986 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.717250 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1041244-e2f3-41fc-a26d-2e8d84f09106 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.722700 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd696bf-7b3a-4870-987e-3e1fb6fcb773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.723397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd696bf-7b3a-4870-987e-3e1fb6fcb773 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.723674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd696bf-7b3a-4870-987e-3e1fb6fcb773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.723942 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd696bf-7b3a-4870-987e-3e1fb6fcb773 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.724654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd696bf-7b3a-4870-987e-3e1fb6fcb773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.726234 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd696bf-7b3a-4870-987e-3e1fb6fcb773 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.736220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 790/1568] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:57.739677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd696bf-7b3a-4870-987e-3e1fb6fcb773 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.746122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd696bf-7b3a-4870-987e-3e1fb6fcb773 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.751196 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d0d30-0151-411a-87f3-1333a75fe254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.751803 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce370e-a37b-43e4-b28e-064db3864349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.751910 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0d30-0151-411a-87f3-1333a75fe254 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.752076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0d30-0151-411a-87f3-1333a75fe254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.752348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0d30-0151-411a-87f3-1333a75fe254 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.752461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce370e-a37b-43e4-b28e-064db3864349 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.752681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce370e-a37b-43e4-b28e-064db3864349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.752958 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce370e-a37b-43e4-b28e-064db3864349 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.753073 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d0d30-0151-411a-87f3-1333a75fe254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:37:57.753330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d0d30-0151-411a-87f3-1333a75fe254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.753675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce370e-a37b-43e4-b28e-064db3864349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:37:57.753981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce370e-a37b-43e4-b28e-064db3864349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.754872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d0d30-0151-411a-87f3-1333a75fe254 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.755004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING py.warnings [None req-a6ce370e-a37b-43e4-b28e-064db3864349 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:37:57.755004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: warnings.warn(msg) Feb 28 10:37:57.755004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: Feb 28 10:37:57.755893 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce370e-a37b-43e4-b28e-064db3864349 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.772600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 791/1569] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:37:57.772786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 779/1570] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:37:57.772881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d0d30-0151-411a-87f3-1333a75fe254 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.772972 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce370e-a37b-43e4-b28e-064db3864349 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.777971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d0d30-0151-411a-87f3-1333a75fe254 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.782768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60287073-6a0c-49b4-b8c2-e6865980ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.783435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60287073-6a0c-49b4-b8c2-e6865980ecce admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.783717 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60287073-6a0c-49b4-b8c2-e6865980ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.783834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce370e-a37b-43e4-b28e-064db3864349 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.783993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60287073-6a0c-49b4-b8c2-e6865980ecce admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.784733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60287073-6a0c-49b4-b8c2-e6865980ecce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:37:57.785040 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60287073-6a0c-49b4-b8c2-e6865980ecce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.786612 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60287073-6a0c-49b4-b8c2-e6865980ecce admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.788382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec88d2-0ac9-480b-848c-6c7c1ece6a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.789040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec88d2-0ac9-480b-848c-6c7c1ece6a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.789313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec88d2-0ac9-480b-848c-6c7c1ece6a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.789583 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec88d2-0ac9-480b-848c-6c7c1ece6a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.790281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec88d2-0ac9-480b-848c-6c7c1ece6a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:37:57.790574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec88d2-0ac9-480b-848c-6c7c1ece6a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.792169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec88d2-0ac9-480b-848c-6c7c1ece6a00 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.798604 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 792/1571] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:37:57.799445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60287073-6a0c-49b4-b8c2-e6865980ecce admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.808437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60287073-6a0c-49b4-b8c2-e6865980ecce admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.818261 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 780/1572] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:37:57.818261 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec88d2-0ac9-480b-848c-6c7c1ece6a00 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.820602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65b14a-2540-4a51-b654-a79b4ad6d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.821245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65b14a-2540-4a51-b654-a79b4ad6d3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.821526 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65b14a-2540-4a51-b654-a79b4ad6d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.821706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec88d2-0ac9-480b-848c-6c7c1ece6a00 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.821811 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65b14a-2540-4a51-b654-a79b4ad6d3d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.822502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65b14a-2540-4a51-b654-a79b4ad6d3d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:37:57.822807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65b14a-2540-4a51-b654-a79b4ad6d3d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.824447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65b14a-2540-4a51-b654-a79b4ad6d3d3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.826308 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a6f87-1150-41c7-a9aa-a3f45b33d7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.826970 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6f87-1150-41c7-a9aa-a3f45b33d7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.827247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6f87-1150-41c7-a9aa-a3f45b33d7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.827514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6f87-1150-41c7-a9aa-a3f45b33d7d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.828184 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a6f87-1150-41c7-a9aa-a3f45b33d7d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.830304 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a6f87-1150-41c7-a9aa-a3f45b33d7d4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.836705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 793/1573] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:37:57.837510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65b14a-2540-4a51-b654-a79b4ad6d3d3 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.854311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65b14a-2540-4a51-b654-a79b4ad6d3d3 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.859408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea782afe-1640-4098-a750-00bd0e89f894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.860072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea782afe-1640-4098-a750-00bd0e89f894 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.860468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea782afe-1640-4098-a750-00bd0e89f894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.860941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea782afe-1640-4098-a750-00bd0e89f894 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.864447 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 781/1574] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/users => generated 285 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:57.864596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea782afe-1640-4098-a750-00bd0e89f894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.864701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a6f87-1150-41c7-a9aa-a3f45b33d7d4 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.864785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea782afe-1640-4098-a750-00bd0e89f894 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.871581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a6f87-1150-41c7-a9aa-a3f45b33d7d4 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.877244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 794/1575] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:57.877244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea782afe-1640-4098-a750-00bd0e89f894 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.879509 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae6852-e8b3-4fbb-9325-47f8f67494df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.880370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae6852-e8b3-4fbb-9325-47f8f67494df admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.880643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae6852-e8b3-4fbb-9325-47f8f67494df admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.880912 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae6852-e8b3-4fbb-9325-47f8f67494df admin admin] PATH_INFO: `/v3/projects/c464215d373b445b8cb286adc7e13360/users/3fb5b835349e4b549f9e6fff509bd4c0/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.886270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea782afe-1640-4098-a750-00bd0e89f894 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.890775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0fdbd-49ee-4f28-8c93-d373faae4db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.891426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fdbd-49ee-4f28-8c93-d373faae4db5 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.891706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fdbd-49ee-4f28-8c93-d373faae4db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.891978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fdbd-49ee-4f28-8c93-d373faae4db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.892656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0fdbd-49ee-4f28-8c93-d373faae4db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.894519 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0fdbd-49ee-4f28-8c93-d373faae4db5 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.895385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae6852-e8b3-4fbb-9325-47f8f67494df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c464215d373b445b8cb286adc7e13360, user_id=3fb5b835349e4b549f9e6fff509bd4c0, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.897995 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae6852-e8b3-4fbb-9325-47f8f67494df admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:57.910958 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 782/1576] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:57 2022] PUT /identity/v3/projects/c464215d373b445b8cb286adc7e13360/users/3fb5b835349e4b549f9e6fff509bd4c0/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:57.914274 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae6852-e8b3-4fbb-9325-47f8f67494df admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.927973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 795/1577] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:57.928644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0fdbd-49ee-4f28-8c93-d373faae4db5 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:57.972447 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae6852-e8b3-4fbb-9325-47f8f67494df admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.987207 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0fdbd-49ee-4f28-8c93-d373faae4db5 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:57.991782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b7cfd-e0ae-448a-b121-d6db868dded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:57.992437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b7cfd-e0ae-448a-b121-d6db868dded2 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:57.992719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b7cfd-e0ae-448a-b121-d6db868dded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:57.992990 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b7cfd-e0ae-448a-b121-d6db868dded2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:57.993668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b7cfd-e0ae-448a-b121-d6db868dded2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:57.995638 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b7cfd-e0ae-448a-b121-d6db868dded2 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.019675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 796/1578] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/projects => generated 393 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:58.020472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b7cfd-e0ae-448a-b121-d6db868dded2 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.026585 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39a2d4-8eb7-4ae4-8d0c-149f5ba2edbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.027285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39a2d4-8eb7-4ae4-8d0c-149f5ba2edbf admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.027560 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39a2d4-8eb7-4ae4-8d0c-149f5ba2edbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.027828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39a2d4-8eb7-4ae4-8d0c-149f5ba2edbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.028503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39a2d4-8eb7-4ae4-8d0c-149f5ba2edbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.031000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39a2d4-8eb7-4ae4-8d0c-149f5ba2edbf admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.059123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 783/1579] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:37:57 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:58.059123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39a2d4-8eb7-4ae4-8d0c-149f5ba2edbf admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.079844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b7cfd-e0ae-448a-b121-d6db868dded2 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.116871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39a2d4-8eb7-4ae4-8d0c-149f5ba2edbf admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.121489 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e238d-0a6c-4f5e-b340-339333e0ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.122133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e238d-0a6c-4f5e-b340-339333e0ea65 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.122401 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e238d-0a6c-4f5e-b340-339333e0ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.122677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e238d-0a6c-4f5e-b340-339333e0ea65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.123432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e238d-0a6c-4f5e-b340-339333e0ea65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.125354 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e238d-0a6c-4f5e-b340-339333e0ea65 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.137322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e8294-8d97-43ef-b253-7097c2422879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.137965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e8294-8d97-43ef-b253-7097c2422879 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.138270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e8294-8d97-43ef-b253-7097c2422879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.138544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e8294-8d97-43ef-b253-7097c2422879 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.139266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e8294-8d97-43ef-b253-7097c2422879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.141151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e8294-8d97-43ef-b253-7097c2422879 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.150398 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 784/1580] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:58.151245 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e238d-0a6c-4f5e-b340-339333e0ea65 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.170432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 797/1581] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:58.171500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e8294-8d97-43ef-b253-7097c2422879 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.211775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e238d-0a6c-4f5e-b340-339333e0ea65 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.229095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e8294-8d97-43ef-b253-7097c2422879 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.233707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad84ed9-67a4-4f4c-be5e-62779f9e5e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.234362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84ed9-67a4-4f4c-be5e-62779f9e5e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.234643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84ed9-67a4-4f4c-be5e-62779f9e5e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.234943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84ed9-67a4-4f4c-be5e-62779f9e5e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.235695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad84ed9-67a4-4f4c-be5e-62779f9e5e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.237295 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad84ed9-67a4-4f4c-be5e-62779f9e5e56 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.246726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 798/1582] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.248492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbc353-0282-4755-8dd1-3e2a1fba2553 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.248780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbc353-0282-4755-8dd1-3e2a1fba2553 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.249054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbc353-0282-4755-8dd1-3e2a1fba2553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.268820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21548336-744b-462c-9f3e-1704ff2ce15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.269471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548336-744b-462c-9f3e-1704ff2ce15d admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.269761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548336-744b-462c-9f3e-1704ff2ce15d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.270032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548336-744b-462c-9f3e-1704ff2ce15d admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.270740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21548336-744b-462c-9f3e-1704ff2ce15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.272381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21548336-744b-462c-9f3e-1704ff2ce15d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.274966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-82bbc353-0282-4755-8dd1-3e2a1fba2553 None None] MFA Rules not processed for user `3fb5b835349e4b549f9e6fff509bd4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:58.276169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-82bbc353-0282-4755-8dd1-3e2a1fba2553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:58.281944 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 785/1583] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.285548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21548336-744b-462c-9f3e-1704ff2ce15d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.294713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21548336-744b-462c-9f3e-1704ff2ce15d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.299195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e7250-8d43-4a85-b6b5-1dd36608a7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.299806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e7250-8d43-4a85-b6b5-1dd36608a7ce admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.300081 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e7250-8d43-4a85-b6b5-1dd36608a7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.300350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e7250-8d43-4a85-b6b5-1dd36608a7ce admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.301034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e7250-8d43-4a85-b6b5-1dd36608a7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.302875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e7250-8d43-4a85-b6b5-1dd36608a7ce admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.323417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 786/1584] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/users => generated 294 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:58.324027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e7250-8d43-4a85-b6b5-1dd36608a7ce admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.333590 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e7250-8d43-4a85-b6b5-1dd36608a7ce admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.338087 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4527418-aea7-482d-ba20-7af03459a4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.338656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4527418-aea7-482d-ba20-7af03459a4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.338955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4527418-aea7-482d-ba20-7af03459a4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.339233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4527418-aea7-482d-ba20-7af03459a4f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.339899 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4527418-aea7-482d-ba20-7af03459a4f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.341803 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4527418-aea7-482d-ba20-7af03459a4f0 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.342623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 799/1585] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:58.346325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbc353-0282-4755-8dd1-3e2a1fba2553 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.354924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbc353-0282-4755-8dd1-3e2a1fba2553 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.359602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af388f1-24fa-46c4-a5f4-8604f4c8be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.360248 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af388f1-24fa-46c4-a5f4-8604f4c8be57 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.360538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af388f1-24fa-46c4-a5f4-8604f4c8be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.360803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af388f1-24fa-46c4-a5f4-8604f4c8be57 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.360976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 787/1586] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/users => generated 297 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:58.361496 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af388f1-24fa-46c4-a5f4-8604f4c8be57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.361738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4527418-aea7-482d-ba20-7af03459a4f0 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.363418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af388f1-24fa-46c4-a5f4-8604f4c8be57 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.370670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4527418-aea7-482d-ba20-7af03459a4f0 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.376764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468ae01-ee86-4666-8399-6bf2733c4241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.377510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468ae01-ee86-4666-8399-6bf2733c4241 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.377812 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468ae01-ee86-4666-8399-6bf2733c4241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.378136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468ae01-ee86-4666-8399-6bf2733c4241 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.378868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468ae01-ee86-4666-8399-6bf2733c4241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.380765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468ae01-ee86-4666-8399-6bf2733c4241 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.384673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 800/1587] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:58.389409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af388f1-24fa-46c4-a5f4-8604f4c8be57 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.399458 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af388f1-24fa-46c4-a5f4-8604f4c8be57 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.403329 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 788/1588] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:58.404146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468ae01-ee86-4666-8399-6bf2733c4241 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.407373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f850d-6167-48a7-9b44-b9b0b59db57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.408064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f850d-6167-48a7-9b44-b9b0b59db57e admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.408477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f850d-6167-48a7-9b44-b9b0b59db57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.408757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f850d-6167-48a7-9b44-b9b0b59db57e admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.409442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f850d-6167-48a7-9b44-b9b0b59db57e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.411400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f850d-6167-48a7-9b44-b9b0b59db57e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.413778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468ae01-ee86-4666-8399-6bf2733c4241 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.418517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f346f-35e0-4af2-baed-d30165bf6be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.419952 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f346f-35e0-4af2-baed-d30165bf6be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.420266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f346f-35e0-4af2-baed-d30165bf6be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.421154 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f346f-35e0-4af2-baed-d30165bf6be3 admin admin] PATH_INFO: `/v3/projects/12c28d6a93204fbf9adffe45dec819b3/users/d1ae0d46d51c461994cce6b064445442/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.440279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 801/1589] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/users => generated 290 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:58.440279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f850d-6167-48a7-9b44-b9b0b59db57e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.442597 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f346f-35e0-4af2-baed-d30165bf6be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c28d6a93204fbf9adffe45dec819b3, user_id=d1ae0d46d51c461994cce6b064445442, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.445327 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f346f-35e0-4af2-baed-d30165bf6be3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.447509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f850d-6167-48a7-9b44-b9b0b59db57e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.452726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d435e-8aba-4d4f-926a-1dd90ea69fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.453361 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d435e-8aba-4d4f-926a-1dd90ea69fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.453639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d435e-8aba-4d4f-926a-1dd90ea69fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.453913 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d435e-8aba-4d4f-926a-1dd90ea69fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.454624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d435e-8aba-4d4f-926a-1dd90ea69fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.456217 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d435e-8aba-4d4f-926a-1dd90ea69fd0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.458314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 789/1590] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:58 2022] PUT /identity/v3/projects/12c28d6a93204fbf9adffe45dec819b3/users/d1ae0d46d51c461994cce6b064445442/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:58.459140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f346f-35e0-4af2-baed-d30165bf6be3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.468296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 802/1591] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.468296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d435e-8aba-4d4f-926a-1dd90ea69fd0 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.478974 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d435e-8aba-4d4f-926a-1dd90ea69fd0 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.528726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f346f-35e0-4af2-baed-d30165bf6be3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.533461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0addb-44b4-43fd-98f0-381cf6dc253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.534124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0addb-44b4-43fd-98f0-381cf6dc253b admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.534400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0addb-44b4-43fd-98f0-381cf6dc253b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.534500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26bb3-1c4c-4ce1-b7ab-920657ec879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.534671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0addb-44b4-43fd-98f0-381cf6dc253b admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.535166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26bb3-1c4c-4ce1-b7ab-920657ec879d admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.535421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0addb-44b4-43fd-98f0-381cf6dc253b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.535527 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26bb3-1c4c-4ce1-b7ab-920657ec879d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.535701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26bb3-1c4c-4ce1-b7ab-920657ec879d admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.536385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f26bb3-1c4c-4ce1-b7ab-920657ec879d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.537011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0addb-44b4-43fd-98f0-381cf6dc253b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.538235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f26bb3-1c4c-4ce1-b7ab-920657ec879d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.547276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 790/1592] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.548045 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0addb-44b4-43fd-98f0-381cf6dc253b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.558016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0addb-44b4-43fd-98f0-381cf6dc253b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.563285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3fb7-6ebb-4217-9035-cca670679c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.563909 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3fb7-6ebb-4217-9035-cca670679c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.564188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3fb7-6ebb-4217-9035-cca670679c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.564454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3fb7-6ebb-4217-9035-cca670679c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.565155 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac3fb7-6ebb-4217-9035-cca670679c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.565283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 803/1593] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/projects => generated 355 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:58.566729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac3fb7-6ebb-4217-9035-cca670679c49 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.569174 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26bb3-1c4c-4ce1-b7ab-920657ec879d admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.579356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 791/1594] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.579356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3fb7-6ebb-4217-9035-cca670679c49 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.586161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3fb7-6ebb-4217-9035-cca670679c49 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.628447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26bb3-1c4c-4ce1-b7ab-920657ec879d admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.633491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcd53d-f206-43b2-944e-1d7319b035da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.634143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcd53d-f206-43b2-944e-1d7319b035da admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.634421 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcd53d-f206-43b2-944e-1d7319b035da admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.634699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcd53d-f206-43b2-944e-1d7319b035da admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.635446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcd53d-f206-43b2-944e-1d7319b035da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.637047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcd53d-f206-43b2-944e-1d7319b035da admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.639540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910701-4331-4cb3-bd83-61e92f9ffdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.640196 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910701-4331-4cb3-bd83-61e92f9ffdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.640477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910701-4331-4cb3-bd83-61e92f9ffdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.640751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910701-4331-4cb3-bd83-61e92f9ffdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.641468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e910701-4331-4cb3-bd83-61e92f9ffdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.643100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e910701-4331-4cb3-bd83-61e92f9ffdc3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.649510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 804/1595] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.649510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcd53d-f206-43b2-944e-1d7319b035da admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.655477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 792/1596] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.655477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f1328-2f9d-4804-a06b-fac2ec65b3f6 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.655477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f1328-2f9d-4804-a06b-fac2ec65b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.655477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f1328-2f9d-4804-a06b-fac2ec65b3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.656915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcd53d-f206-43b2-944e-1d7319b035da admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.661386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af09c0b-9b2c-416b-bcea-311a3ac9c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.662072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af09c0b-9b2c-416b-bcea-311a3ac9c42e admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.662354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af09c0b-9b2c-416b-bcea-311a3ac9c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.662628 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af09c0b-9b2c-416b-bcea-311a3ac9c42e admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.663367 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af09c0b-9b2c-416b-bcea-311a3ac9c42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.664924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af09c0b-9b2c-416b-bcea-311a3ac9c42e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.677754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 805/1597] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.677754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af09c0b-9b2c-416b-bcea-311a3ac9c42e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.680224 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-1d9f1328-2f9d-4804-a06b-fac2ec65b3f6 None None] MFA Rules not processed for user `d1ae0d46d51c461994cce6b064445442`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:58.681421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-1d9f1328-2f9d-4804-a06b-fac2ec65b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:58.685777 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af09c0b-9b2c-416b-bcea-311a3ac9c42e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.690202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3bc5e-5d60-4d55-8c36-771999582e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.691070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3bc5e-5d60-4d55-8c36-771999582e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.691353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3bc5e-5d60-4d55-8c36-771999582e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.691632 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3bc5e-5d60-4d55-8c36-771999582e35 admin admin] PATH_INFO: `/v3/projects/c0a15fac3d664e879e118b83dd18e351/users/e668cd69acbb45af8f390c34bc57b830/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.705830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3bc5e-5d60-4d55-8c36-771999582e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a15fac3d664e879e118b83dd18e351, user_id=e668cd69acbb45af8f390c34bc57b830, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.706845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING py.warnings [None req-afb3bc5e-5d60-4d55-8c36-771999582e35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:37:58.706845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: warnings.warn(msg) Feb 28 10:37:58.706845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: Feb 28 10:37:58.708771 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3bc5e-5d60-4d55-8c36-771999582e35 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.722617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 806/1598] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:58 2022] PUT /identity/v3/projects/c0a15fac3d664e879e118b83dd18e351/users/e668cd69acbb45af8f390c34bc57b830/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:58.723390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3bc5e-5d60-4d55-8c36-771999582e35 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.749000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 793/1599] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:58.749814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f1328-2f9d-4804-a06b-fac2ec65b3f6 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.760070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f1328-2f9d-4804-a06b-fac2ec65b3f6 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.796986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3bc5e-5d60-4d55-8c36-771999582e35 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.801523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85abec5-b8a7-43ec-b78a-378b80f6babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.802182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abec5-b8a7-43ec-b78a-378b80f6babf admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.802461 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abec5-b8a7-43ec-b78a-378b80f6babf admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.802736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abec5-b8a7-43ec-b78a-378b80f6babf admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.803484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85abec5-b8a7-43ec-b78a-378b80f6babf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.805067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85abec5-b8a7-43ec-b78a-378b80f6babf admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.814946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 807/1600] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.815117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077090-f23b-4b5b-b984-2aab01c8c0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.815864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077090-f23b-4b5b-b984-2aab01c8c0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.816068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85abec5-b8a7-43ec-b78a-378b80f6babf admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.816165 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077090-f23b-4b5b-b984-2aab01c8c0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.816453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077090-f23b-4b5b-b984-2aab01c8c0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.817082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47077090-f23b-4b5b-b984-2aab01c8c0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.819011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47077090-f23b-4b5b-b984-2aab01c8c0b7 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.825341 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85abec5-b8a7-43ec-b78a-378b80f6babf admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.829962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448bc8a-295d-444d-82b9-344e9898d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.830693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448bc8a-295d-444d-82b9-344e9898d06a admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.831020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448bc8a-295d-444d-82b9-344e9898d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.831334 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448bc8a-295d-444d-82b9-344e9898d06a admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.832086 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448bc8a-295d-444d-82b9-344e9898d06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.833766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448bc8a-295d-444d-82b9-344e9898d06a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.838682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 794/1601] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:58.839519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077090-f23b-4b5b-b984-2aab01c8c0b7 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.850502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 808/1602] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.850502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448bc8a-295d-444d-82b9-344e9898d06a admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.850754 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077090-f23b-4b5b-b984-2aab01c8c0b7 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.854833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cd195-3b72-4502-84a1-47086b6a39d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.855521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cd195-3b72-4502-84a1-47086b6a39d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.855804 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cd195-3b72-4502-84a1-47086b6a39d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.856078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cd195-3b72-4502-84a1-47086b6a39d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.856793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cd195-3b72-4502-84a1-47086b6a39d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.858315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448bc8a-295d-444d-82b9-344e9898d06a admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.858998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cd195-3b72-4502-84a1-47086b6a39d1 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.862847 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40d8b0-4d9c-4cca-9d3b-2e747c9f314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.863491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40d8b0-4d9c-4cca-9d3b-2e747c9f314d admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.863773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40d8b0-4d9c-4cca-9d3b-2e747c9f314d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.864049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40d8b0-4d9c-4cca-9d3b-2e747c9f314d admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.864750 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40d8b0-4d9c-4cca-9d3b-2e747c9f314d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.866298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40d8b0-4d9c-4cca-9d3b-2e747c9f314d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.868866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 795/1603] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.869573 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cd195-3b72-4502-84a1-47086b6a39d1 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.878862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 809/1604] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.878862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d089a-c7de-4621-bf9b-73352f2fa5b6 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.878862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d089a-c7de-4621-bf9b-73352f2fa5b6 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.878862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d089a-c7de-4621-bf9b-73352f2fa5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.879262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cd195-3b72-4502-84a1-47086b6a39d1 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.884028 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408e381-c4e8-44b7-9102-91e64a6b272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.884686 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408e381-c4e8-44b7-9102-91e64a6b272e admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.884964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408e381-c4e8-44b7-9102-91e64a6b272e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.885234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408e381-c4e8-44b7-9102-91e64a6b272e admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.885970 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408e381-c4e8-44b7-9102-91e64a6b272e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.887610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408e381-c4e8-44b7-9102-91e64a6b272e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.897825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 796/1605] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:58.899139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644f3d-2488-4440-a2c6-fb855e5062f8 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.899419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644f3d-2488-4440-a2c6-fb855e5062f8 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.899687 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644f3d-2488-4440-a2c6-fb855e5062f8 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.901636 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 797/1606] 10.222.0.44 () {54 vars in 961 bytes} [Mon Feb 28 10:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:37:58.902233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03644f3d-2488-4440-a2c6-fb855e5062f8 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.903394 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-ce9d089a-c7de-4621-bf9b-73352f2fa5b6 None None] MFA Rules not processed for user `e668cd69acbb45af8f390c34bc57b830`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:58.905156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ce9d089a-c7de-4621-bf9b-73352f2fa5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:58.915235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03644f3d-2488-4440-a2c6-fb855e5062f8 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:58.919902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b292ac-cab3-49d5-9d50-3541977f6709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:58.920739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b292ac-cab3-49d5-9d50-3541977f6709 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:58.921018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b292ac-cab3-49d5-9d50-3541977f6709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:58.921291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b292ac-cab3-49d5-9d50-3541977f6709 admin admin] PATH_INFO: `/v3/projects/6825cb4cea9e4921b5312dd51b9920be/users/e8a15e844eba4dd8864ff1fe152d9d63/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:58.935673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b292ac-cab3-49d5-9d50-3541977f6709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6825cb4cea9e4921b5312dd51b9920be, user_id=e8a15e844eba4dd8864ff1fe152d9d63, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:58.938291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b292ac-cab3-49d5-9d50-3541977f6709 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:58.951223 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 798/1607] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:58 2022] PUT /identity/v3/projects/6825cb4cea9e4921b5312dd51b9920be/users/e8a15e844eba4dd8864ff1fe152d9d63/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:58.952004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b292ac-cab3-49d5-9d50-3541977f6709 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.969414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 810/1608] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:58.970065 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d089a-c7de-4621-bf9b-73352f2fa5b6 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:58.979772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d089a-c7de-4621-bf9b-73352f2fa5b6 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.013371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b292ac-cab3-49d5-9d50-3541977f6709 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.018477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae817c-b168-4d28-9619-1e855f47dacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.019161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae817c-b168-4d28-9619-1e855f47dacd admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.019438 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae817c-b168-4d28-9619-1e855f47dacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.019711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae817c-b168-4d28-9619-1e855f47dacd admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.020431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae817c-b168-4d28-9619-1e855f47dacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.022016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae817c-b168-4d28-9619-1e855f47dacd admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.032373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 799/1609] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:59.033134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae817c-b168-4d28-9619-1e855f47dacd admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.033250 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad79b3-0508-4d97-9897-e7b8c57c59d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.034120 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad79b3-0508-4d97-9897-e7b8c57c59d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.034401 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad79b3-0508-4d97-9897-e7b8c57c59d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.034674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad79b3-0508-4d97-9897-e7b8c57c59d4 admin admin] PATH_INFO: `/v3/projects/61d81f9de04c480389701ad30319c05a/users/4d553b919f944c7a80ec345da995fbc5/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.042774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae817c-b168-4d28-9619-1e855f47dacd admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.048146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fcd6f-f988-4a8b-8477-d463498a049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.049028 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fcd6f-f988-4a8b-8477-d463498a049a admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.049303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fcd6f-f988-4a8b-8477-d463498a049a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.049574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fcd6f-f988-4a8b-8477-d463498a049a admin admin] PATH_INFO: `/v3/projects/4151886992af47f89a22d8119c3ffd94/users/b17dd7414b474fcfb8406d11fef7e95d/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.050959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad79b3-0508-4d97-9897-e7b8c57c59d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d81f9de04c480389701ad30319c05a, user_id=4d553b919f944c7a80ec345da995fbc5, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.053620 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad79b3-0508-4d97-9897-e7b8c57c59d4 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.064827 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fcd6f-f988-4a8b-8477-d463498a049a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4151886992af47f89a22d8119c3ffd94, user_id=b17dd7414b474fcfb8406d11fef7e95d, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.066364 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 811/1610] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:58 2022] PUT /identity/v3/projects/61d81f9de04c480389701ad30319c05a/users/4d553b919f944c7a80ec345da995fbc5/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:59.067173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad79b3-0508-4d97-9897-e7b8c57c59d4 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.067534 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fcd6f-f988-4a8b-8477-d463498a049a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.086674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 800/1611] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:59 2022] PUT /identity/v3/projects/4151886992af47f89a22d8119c3ffd94/users/b17dd7414b474fcfb8406d11fef7e95d/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:59.087516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fcd6f-f988-4a8b-8477-d463498a049a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.127346 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad79b3-0508-4d97-9897-e7b8c57c59d4 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.152003 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fcd6f-f988-4a8b-8477-d463498a049a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.157970 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd4d54-0902-4854-8e1a-06bbc60f9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.158856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4d54-0902-4854-8e1a-06bbc60f9def admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.159164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4d54-0902-4854-8e1a-06bbc60f9def admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.159436 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4d54-0902-4854-8e1a-06bbc60f9def admin admin] PATH_INFO: `/v3/projects/d07247712e664711bc6778d697ef6757/users/6314c5e3ae2442cf90b0299e47999654/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.174181 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd4d54-0902-4854-8e1a-06bbc60f9def admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07247712e664711bc6778d697ef6757, user_id=6314c5e3ae2442cf90b0299e47999654, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.176848 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd4d54-0902-4854-8e1a-06bbc60f9def admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.184478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de75e0a-9abe-4d15-bee5-8a151316ec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.185403 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de75e0a-9abe-4d15-bee5-8a151316ec4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.185687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de75e0a-9abe-4d15-bee5-8a151316ec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.185958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de75e0a-9abe-4d15-bee5-8a151316ec4b admin admin] PATH_INFO: `/v3/projects/4ea56762733b4365a74b1ddc2b4b2045/users/42aece3b204948128fd861aaadd0087d/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.189669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 801/1612] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:59 2022] PUT /identity/v3/projects/d07247712e664711bc6778d697ef6757/users/6314c5e3ae2442cf90b0299e47999654/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:59.194659 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf73aa-f394-41e7-a9b3-6a01fd076c10 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.194963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf73aa-f394-41e7-a9b3-6a01fd076c10 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.195238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf73aa-f394-41e7-a9b3-6a01fd076c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.199881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de75e0a-9abe-4d15-bee5-8a151316ec4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea56762733b4365a74b1ddc2b4b2045, user_id=42aece3b204948128fd861aaadd0087d, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.203148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de75e0a-9abe-4d15-bee5-8a151316ec4b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.214172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-cdaf73aa-f394-41e7-a9b3-6a01fd076c10 None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:59.215403 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-cdaf73aa-f394-41e7-a9b3-6a01fd076c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:59.216091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 812/1613] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:59 2022] PUT /identity/v3/projects/4ea56762733b4365a74b1ddc2b4b2045/users/42aece3b204948128fd861aaadd0087d/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:59.217869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eef68-fad9-4225-8fcc-7f5846df8b97 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.218159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eef68-fad9-4225-8fcc-7f5846df8b97 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.218434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eef68-fad9-4225-8fcc-7f5846df8b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.235218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e24eef68-fad9-4225-8fcc-7f5846df8b97 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:59.236422 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e24eef68-fad9-4225-8fcc-7f5846df8b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:59.290582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 802/1614] 10.222.0.44 () {58 vars in 1058 bytes} [Mon Feb 28 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:59.291417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf73aa-f394-41e7-a9b3-6a01fd076c10 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.295757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 813/1615] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:59.295757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eef68-fad9-4225-8fcc-7f5846df8b97 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.301218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf73aa-f394-41e7-a9b3-6a01fd076c10 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.306198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea343e2-e8c7-4d87-8e9c-9ede19e9524c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.306833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea343e2-e8c7-4d87-8e9c-9ede19e9524c admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.307135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea343e2-e8c7-4d87-8e9c-9ede19e9524c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.307400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea343e2-e8c7-4d87-8e9c-9ede19e9524c admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.308071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea343e2-e8c7-4d87-8e9c-9ede19e9524c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.308421 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eef68-fad9-4225-8fcc-7f5846df8b97 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.309946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea343e2-e8c7-4d87-8e9c-9ede19e9524c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.313188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b671a6-2946-4186-8a0f-a5901a089ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.314182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b671a6-2946-4186-8a0f-a5901a089ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.314544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b671a6-2946-4186-8a0f-a5901a089ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.314796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b671a6-2946-4186-8a0f-a5901a089ce6 admin admin] PATH_INFO: `/v3/projects/80c92daa914d4271828dafc1cc33dbeb/users/747e765f6be140ae9a4708031d290f77/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.330394 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b671a6-2946-4186-8a0f-a5901a089ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c92daa914d4271828dafc1cc33dbeb, user_id=747e765f6be140ae9a4708031d290f77, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.333072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b671a6-2946-4186-8a0f-a5901a089ce6 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.335299 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 803/1616] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:37:59 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:59.336548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c185f7b-2427-480a-bec7-0bd1705c715e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.336829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c185f7b-2427-480a-bec7-0bd1705c715e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.337159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c185f7b-2427-480a-bec7-0bd1705c715e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.347955 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 814/1617] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:59 2022] PUT /identity/v3/projects/80c92daa914d4271828dafc1cc33dbeb/users/747e765f6be140ae9a4708031d290f77/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:59.349021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678837-9cf2-430d-9460-4069cace1cc3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.349305 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678837-9cf2-430d-9460-4069cace1cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.349575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678837-9cf2-430d-9460-4069cace1cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.355686 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0c185f7b-2427-480a-bec7-0bd1705c715e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:59.357476 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0c185f7b-2427-480a-bec7-0bd1705c715e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:59.366649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-20678837-9cf2-430d-9460-4069cace1cc3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:59.367836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-20678837-9cf2-430d-9460-4069cace1cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:59.413633 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 804/1618] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:59.415236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aff9b-c18e-491f-8426-e90e00010471 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.415524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aff9b-c18e-491f-8426-e90e00010471 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.415801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aff9b-c18e-491f-8426-e90e00010471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.427277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 815/1619] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:59.428571 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c437e-886c-4f92-b94d-83cdcbb71ebc None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.428859 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c437e-886c-4f92-b94d-83cdcbb71ebc None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.429132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c437e-886c-4f92-b94d-83cdcbb71ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.438218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-b03aff9b-c18e-491f-8426-e90e00010471 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:59.439558 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b03aff9b-c18e-491f-8426-e90e00010471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:59.447322 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 805/1620] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:59.448108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aff9b-c18e-491f-8426-e90e00010471 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.455328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-565c437e-886c-4f92-b94d-83cdcbb71ebc None None] MFA Rules not processed for user `42aece3b204948128fd861aaadd0087d`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:59.456631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-565c437e-886c-4f92-b94d-83cdcbb71ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:59.515026 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aff9b-c18e-491f-8426-e90e00010471 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.518514 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 816/1621] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:59.519374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c437e-886c-4f92-b94d-83cdcbb71ebc None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.520834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6da79-de2d-44c7-b671-c896e7c9fb15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.521570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6da79-de2d-44c7-b671-c896e7c9fb15 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.521916 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6da79-de2d-44c7-b671-c896e7c9fb15 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.522258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6da79-de2d-44c7-b671-c896e7c9fb15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.573970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c437e-886c-4f92-b94d-83cdcbb71ebc None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.576964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6da79-de2d-44c7-b671-c896e7c9fb15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.577601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594e419-a665-404f-96fe-5c3c3fe16c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.578235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e419-a665-404f-96fe-5c3c3fe16c38 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.578514 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e419-a665-404f-96fe-5c3c3fe16c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.578639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6da79-de2d-44c7-b671-c896e7c9fb15 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.578789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e419-a665-404f-96fe-5c3c3fe16c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.587380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 806/1622] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:59.587594 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594e419-a665-404f-96fe-5c3c3fe16c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.588054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6da79-de2d-44c7-b671-c896e7c9fb15 service nova] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.589007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594e419-a665-404f-96fe-5c3c3fe16c38 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.598133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6da79-de2d-44c7-b671-c896e7c9fb15 service nova] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.599157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 817/1623] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:59.600016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594e419-a665-404f-96fe-5c3c3fe16c38 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.608089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930df22-066f-45ae-ad36-e3111af3597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.608986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930df22-066f-45ae-ad36-e3111af3597f admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.609323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930df22-066f-45ae-ad36-e3111af3597f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.609444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594e419-a665-404f-96fe-5c3c3fe16c38 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.609600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930df22-066f-45ae-ad36-e3111af3597f admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.610423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930df22-066f-45ae-ad36-e3111af3597f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.613549 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930df22-066f-45ae-ad36-e3111af3597f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.614400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a95d24-71e0-4eee-98ea-796bc23f7c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.615217 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a95d24-71e0-4eee-98ea-796bc23f7c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.615351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a95d24-71e0-4eee-98ea-796bc23f7c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.615609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a95d24-71e0-4eee-98ea-796bc23f7c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.616316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a95d24-71e0-4eee-98ea-796bc23f7c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.617903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a95d24-71e0-4eee-98ea-796bc23f7c70 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.628659 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 818/1624] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:59.629715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a95d24-71e0-4eee-98ea-796bc23f7c70 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.635075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c9a95d24-71e0-4eee-98ea-796bc23f7c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:59.641771 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 807/1625] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:37:59 2022] POST /identity/v3/users => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:59.642862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930df22-066f-45ae-ad36-e3111af3597f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.650255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a95d24-71e0-4eee-98ea-796bc23f7c70 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.654779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7b75-429e-4788-a7ee-8f693ca21ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.655039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930df22-066f-45ae-ad36-e3111af3597f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.655525 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7b75-429e-4788-a7ee-8f693ca21ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.655808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7b75-429e-4788-a7ee-8f693ca21ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.656086 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7b75-429e-4788-a7ee-8f693ca21ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.659851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcb2e4-63c0-490f-9cca-0a10b506e700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.660511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb2e4-63c0-490f-9cca-0a10b506e700 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.660793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb2e4-63c0-490f-9cca-0a10b506e700 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.661068 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb2e4-63c0-490f-9cca-0a10b506e700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.665955 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d7b75-429e-4788-a7ee-8f693ca21ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.667586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d7b75-429e-4788-a7ee-8f693ca21ab2 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.672426 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcb2e4-63c0-490f-9cca-0a10b506e700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.674130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcb2e4-63c0-490f-9cca-0a10b506e700 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.679273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 819/1626] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:59.680358 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7b75-429e-4788-a7ee-8f693ca21ab2 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.689872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7b75-429e-4788-a7ee-8f693ca21ab2 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.695507 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5c5aa-7137-43b1-bc3e-f8496075db80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.696326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5c5aa-7137-43b1-bc3e-f8496075db80 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.696612 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5c5aa-7137-43b1-bc3e-f8496075db80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.696951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5c5aa-7137-43b1-bc3e-f8496075db80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.710100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5c5aa-7137-43b1-bc3e-f8496075db80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.711120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 808/1627] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:59.711880 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5c5aa-7137-43b1-bc3e-f8496075db80 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.712737 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7c99d-13a9-489b-9696-e94b6496cb04 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.713026 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7c99d-13a9-489b-9696-e94b6496cb04 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.713303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7c99d-13a9-489b-9696-e94b6496cb04 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.715421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 809/1628] 10.222.0.44 () {54 vars in 961 bytes} [Mon Feb 28 10:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:37:59.716072 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7c99d-13a9-489b-9696-e94b6496cb04 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.729605 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 820/1629] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:59.730581 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5c5aa-7137-43b1-bc3e-f8496075db80 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.741450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5c5aa-7137-43b1-bc3e-f8496075db80 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.747428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326db2e-9842-4146-960f-c845da67fa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.748806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326db2e-9842-4146-960f-c845da67fa66 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.749557 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326db2e-9842-4146-960f-c845da67fa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.749557 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326db2e-9842-4146-960f-c845da67fa66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.750766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326db2e-9842-4146-960f-c845da67fa66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.750883 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7c99d-13a9-489b-9696-e94b6496cb04 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.752391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326db2e-9842-4146-960f-c845da67fa66 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.761073 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d4a69-9e75-4ab1-a53f-1bbcdc6893bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.761967 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4a69-9e75-4ab1-a53f-1bbcdc6893bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.762730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4a69-9e75-4ab1-a53f-1bbcdc6893bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.762846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4a69-9e75-4ab1-a53f-1bbcdc6893bf admin admin] PATH_INFO: `/v3/projects/80c92daa914d4271828dafc1cc33dbeb/users/747e765f6be140ae9a4708031d290f77/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.769779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 821/1630] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:37:59.770505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d4a69-9e75-4ab1-a53f-1bbcdc6893bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c92daa914d4271828dafc1cc33dbeb, user_id=747e765f6be140ae9a4708031d290f77, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.771603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5cb2f-19cb-44b1-ae83-fbb203c27cce None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.772077 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5cb2f-19cb-44b1-ae83-fbb203c27cce None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.772457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5cb2f-19cb-44b1-ae83-fbb203c27cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.773648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d4a69-9e75-4ab1-a53f-1bbcdc6893bf admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:59.794529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-64f5cb2f-19cb-44b1-ae83-fbb203c27cce None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:59.796148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-64f5cb2f-19cb-44b1-ae83-fbb203c27cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:59.803126 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 810/1631] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:59 2022] PUT /identity/v3/projects/80c92daa914d4271828dafc1cc33dbeb/users/747e765f6be140ae9a4708031d290f77/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:59.804109 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d4a69-9e75-4ab1-a53f-1bbcdc6893bf admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:59.908736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 822/1632] 10.222.0.44 () {58 vars in 1058 bytes} [Mon Feb 28 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:59.910717 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2a75-26da-4370-a423-c6feee096d05 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.911094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2a75-26da-4370-a423-c6feee096d05 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.911550 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2a75-26da-4370-a423-c6feee096d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.948737 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-53ff2a75-26da-4370-a423-c6feee096d05 None None] MFA Rules not processed for user `747e765f6be140ae9a4708031d290f77`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:59.949995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-53ff2a75-26da-4370-a423-c6feee096d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:59.950123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d4a69-9e75-4ab1-a53f-1bbcdc6893bf admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:59.955206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc658c0-18c9-420e-b6c9-ac386a278d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:59.956144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc658c0-18c9-420e-b6c9-ac386a278d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:59.956476 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc658c0-18c9-420e-b6c9-ac386a278d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:59.956761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc658c0-18c9-420e-b6c9-ac386a278d13 admin admin] PATH_INFO: `/v3/projects/4e1f0e0f94814a23932e0d8296245149/users/1f239a75daef49958d4616d16e5f590e/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:59.987209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc658c0-18c9-420e-b6c9-ac386a278d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1f0e0f94814a23932e0d8296245149, user_id=1f239a75daef49958d4616d16e5f590e, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:59.990323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc658c0-18c9-420e-b6c9-ac386a278d13 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:00.008831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 811/1633] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:59 2022] PUT /identity/v3/projects/4e1f0e0f94814a23932e0d8296245149/users/1f239a75daef49958d4616d16e5f590e/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:00.009739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc658c0-18c9-420e-b6c9-ac386a278d13 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:00.049787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 823/1634] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:00.051805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff334-c34f-4a7e-88a7-48c2ee855fb3 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:00.052786 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff334-c34f-4a7e-88a7-48c2ee855fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:00.053077 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff334-c34f-4a7e-88a7-48c2ee855fb3 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:00.055946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 824/1635] 10.222.0.44 () {54 vars in 912 bytes} [Mon Feb 28 10:38:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:38:00.056906 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafff334-c34f-4a7e-88a7-48c2ee855fb3 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:00.125382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc658c0-18c9-420e-b6c9-ac386a278d13 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:00.134574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d84ff-a4a7-4d17-ac69-ccf429337ea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:00.135444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d84ff-a4a7-4d17-ac69-ccf429337ea8 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:00.135723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d84ff-a4a7-4d17-ac69-ccf429337ea8 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:00.135990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d84ff-a4a7-4d17-ac69-ccf429337ea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:00.179930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafff334-c34f-4a7e-88a7-48c2ee855fb3 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:00.186732 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59238873-7a4a-426d-ac94-72988a294422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:00.187547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238873-7a4a-426d-ac94-72988a294422 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:00.187844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238873-7a4a-426d-ac94-72988a294422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:00.188397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238873-7a4a-426d-ac94-72988a294422 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:00.189494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59238873-7a4a-426d-ac94-72988a294422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:00.192145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59238873-7a4a-426d-ac94-72988a294422 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:00.204050 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d84ff-a4a7-4d17-ac69-ccf429337ea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:00.205920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d84ff-a4a7-4d17-ac69-ccf429337ea8 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:00.216004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 812/1636] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:00.217945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9348d06-078f-4e00-98cb-0be8a167362a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:00.218358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9348d06-078f-4e00-98cb-0be8a167362a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:00.218564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9348d06-078f-4e00-98cb-0be8a167362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:00.225529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 825/1637] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:00.227779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59238873-7a4a-426d-ac94-72988a294422 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:00.244697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c9348d06-078f-4e00-98cb-0be8a167362a None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:00.245898 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c9348d06-078f-4e00-98cb-0be8a167362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:00.275192 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 813/1638] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:38:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:00.289945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9348d06-078f-4e00-98cb-0be8a167362a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:00.315915 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9348d06-078f-4e00-98cb-0be8a167362a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:00.324542 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e1b5a-ff69-47d3-b6a4-ac5a7839e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:00.326932 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e1b5a-ff69-47d3-b6a4-ac5a7839e72f admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:00.327828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e1b5a-ff69-47d3-b6a4-ac5a7839e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:00.328911 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e1b5a-ff69-47d3-b6a4-ac5a7839e72f admin admin] PATH_INFO: `/v3/projects/4e1f0e0f94814a23932e0d8296245149/users/1f239a75daef49958d4616d16e5f590e/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:00.333921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e1b5a-ff69-47d3-b6a4-ac5a7839e72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1f0e0f94814a23932e0d8296245149, user_id=1f239a75daef49958d4616d16e5f590e, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:00.340965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e1b5a-ff69-47d3-b6a4-ac5a7839e72f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:00.352323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59238873-7a4a-426d-ac94-72988a294422 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:00.364353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 814/1639] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:00 2022] PUT /identity/v3/projects/4e1f0e0f94814a23932e0d8296245149/users/1f239a75daef49958d4616d16e5f590e/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:00.365718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e1b5a-ff69-47d3-b6a4-ac5a7839e72f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:00.476911 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e1b5a-ff69-47d3-b6a4-ac5a7839e72f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:00.481085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d3b89-dbb6-4731-99fc-84bcbd77e4ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:00.482022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bd6b0-bc70-4086-8757-f0d26902bad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:00.482455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d3b89-dbb6-4731-99fc-84bcbd77e4ff service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:00.483111 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d3b89-dbb6-4731-99fc-84bcbd77e4ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:00.483821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bd6b0-bc70-4086-8757-f0d26902bad0 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:00.484173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bd6b0-bc70-4086-8757-f0d26902bad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:00.484488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d3b89-dbb6-4731-99fc-84bcbd77e4ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:00.484606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bd6b0-bc70-4086-8757-f0d26902bad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:00.600684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bd6b0-bc70-4086-8757-f0d26902bad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:00.600684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bd6b0-bc70-4086-8757-f0d26902bad0 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:00.627143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 815/1640] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:00.628716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ecf23-e8e8-4f51-a379-b69eb4130b82 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:00.629068 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ecf23-e8e8-4f51-a379-b69eb4130b82 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:00.629342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ecf23-e8e8-4f51-a379-b69eb4130b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:00.635740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d3b89-dbb6-4731-99fc-84bcbd77e4ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:00.637287 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d3b89-dbb6-4731-99fc-84bcbd77e4ff service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:00.664192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 826/1641] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:00 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:00.664192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301f961-b565-44e6-9fa4-37bcd336c635 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:00.664192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301f961-b565-44e6-9fa4-37bcd336c635 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:00.664192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301f961-b565-44e6-9fa4-37bcd336c635 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:00.665927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 827/1642] 10.222.0.44 () {54 vars in 912 bytes} [Mon Feb 28 10:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:38:00.675466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aabf83-3a6e-4480-be7b-339a55ba2f89 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:00.675813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aabf83-3a6e-4480-be7b-339a55ba2f89 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:00.676175 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aabf83-3a6e-4480-be7b-339a55ba2f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:00.689257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ac8ecf23-e8e8-4f51-a379-b69eb4130b82 None None] MFA Rules not processed for user `1f239a75daef49958d4616d16e5f590e`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:00.690664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ac8ecf23-e8e8-4f51-a379-b69eb4130b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:00.710978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-71aabf83-3a6e-4480-be7b-339a55ba2f89 None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:00.713456 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-71aabf83-3a6e-4480-be7b-339a55ba2f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:00.737970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 828/1643] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:38:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:38:00.780510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aabf83-3a6e-4480-be7b-339a55ba2f89 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:00.796868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aabf83-3a6e-4480-be7b-339a55ba2f89 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:00.808172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0761c-27ca-455f-9cd3-d687e833ba51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:00.813037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0761c-27ca-455f-9cd3-d687e833ba51 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:00.813037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0761c-27ca-455f-9cd3-d687e833ba51 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:00.813555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0761c-27ca-455f-9cd3-d687e833ba51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:00.838172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 816/1644] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:00.840046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0761c-27ca-455f-9cd3-d687e833ba51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:00.841804 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0761c-27ca-455f-9cd3-d687e833ba51 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:00.858237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 829/1645] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:38:01.672999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ecf23-e8e8-4f51-a379-b69eb4130b82 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:01.695711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ecf23-e8e8-4f51-a379-b69eb4130b82 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:01.713924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a8571-5578-41e7-873f-7727e06d3fef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:01.717799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a8571-5578-41e7-873f-7727e06d3fef service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:01.719826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a8571-5578-41e7-873f-7727e06d3fef service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:01.721019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a8571-5578-41e7-873f-7727e06d3fef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:01.746147 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc936b34-f86f-44ba-b436-b1f407b13649 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:01.746751 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc936b34-f86f-44ba-b436-b1f407b13649 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:01.747034 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc936b34-f86f-44ba-b436-b1f407b13649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:01.772187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a8571-5578-41e7-873f-7727e06d3fef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:01.783230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a8571-5578-41e7-873f-7727e06d3fef service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:01.841095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 817/1646] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:01.850042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-dc936b34-f86f-44ba-b436-b1f407b13649 None None] MFA Rules not processed for user `6314c5e3ae2442cf90b0299e47999654`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:01.853071 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-dc936b34-f86f-44ba-b436-b1f407b13649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:01.952096 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a8571-5578-41e7-873f-7727e06d3fef service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:01.961951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a8571-5578-41e7-873f-7727e06d3fef service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:01.979829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8fb35-5ac1-4735-a66e-f3eae8b5bdfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:01.980609 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8fb35-5ac1-4735-a66e-f3eae8b5bdfd service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:01.980995 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8fb35-5ac1-4735-a66e-f3eae8b5bdfd service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:01.982231 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8fb35-5ac1-4735-a66e-f3eae8b5bdfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:02.056826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 830/1647] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:02.069712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3960fb-bb5a-4f5a-8662-27b5cc9ec5d5 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:02.070285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3960fb-bb5a-4f5a-8662-27b5cc9ec5d5 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:02.070782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3960fb-bb5a-4f5a-8662-27b5cc9ec5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:02.115354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-fc3960fb-bb5a-4f5a-8662-27b5cc9ec5d5 None None] MFA Rules not processed for user `6314c5e3ae2442cf90b0299e47999654`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:02.119760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fc3960fb-bb5a-4f5a-8662-27b5cc9ec5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:02.134118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8fb35-5ac1-4735-a66e-f3eae8b5bdfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:02.152027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8fb35-5ac1-4735-a66e-f3eae8b5bdfd service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:02.163217 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 831/1648] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:38:02.172645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 818/1649] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:01 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:02.319645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3960fb-bb5a-4f5a-8662-27b5cc9ec5d5 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:02.341174 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3960fb-bb5a-4f5a-8662-27b5cc9ec5d5 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:02.355021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8d1de-8f49-4c0c-b008-face9b2ee67c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:02.355856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d1de-8f49-4c0c-b008-face9b2ee67c service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:02.356182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d1de-8f49-4c0c-b008-face9b2ee67c service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:02.356554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d1de-8f49-4c0c-b008-face9b2ee67c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:02.376662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8d1de-8f49-4c0c-b008-face9b2ee67c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:02.379881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8d1de-8f49-4c0c-b008-face9b2ee67c service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:02.412520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 832/1650] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:02.424456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8fb35-5ac1-4735-a66e-f3eae8b5bdfd service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:02.452252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8fb35-5ac1-4735-a66e-f3eae8b5bdfd service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:02.464682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c66ba9-c9d8-4e5c-b190-64b0a9942c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:02.465545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c66ba9-c9d8-4e5c-b190-64b0a9942c13 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:02.465982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c66ba9-c9d8-4e5c-b190-64b0a9942c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:02.467095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c66ba9-c9d8-4e5c-b190-64b0a9942c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:02.620402 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c66ba9-c9d8-4e5c-b190-64b0a9942c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:02.622972 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c66ba9-c9d8-4e5c-b190-64b0a9942c13 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:02.643347 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 819/1651] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:02.892435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b798d4-5f34-4262-9450-7fc207ed0aa8 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:02.893039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b798d4-5f34-4262-9450-7fc207ed0aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:02.893039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b798d4-5f34-4262-9450-7fc207ed0aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:02.927398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-23b798d4-5f34-4262-9450-7fc207ed0aa8 None None] MFA Rules not processed for user `b17dd7414b474fcfb8406d11fef7e95d`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:02.928997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-23b798d4-5f34-4262-9450-7fc207ed0aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:03.015170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 833/1652] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:03.025785 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085543ce-bb6a-4577-bc53-01b6e73e46ce None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:03.026656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085543ce-bb6a-4577-bc53-01b6e73e46ce None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:03.027135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085543ce-bb6a-4577-bc53-01b6e73e46ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:03.045516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-085543ce-bb6a-4577-bc53-01b6e73e46ce None None] MFA Rules not processed for user `b17dd7414b474fcfb8406d11fef7e95d`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:03.047051 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-085543ce-bb6a-4577-bc53-01b6e73e46ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:03.077139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 820/1653] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:03.090312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b798d4-5f34-4262-9450-7fc207ed0aa8 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:03.123819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b798d4-5f34-4262-9450-7fc207ed0aa8 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:03.134520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a710883-227e-487c-918a-f53113e99ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:03.135637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a710883-227e-487c-918a-f53113e99ebf service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:03.136055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a710883-227e-487c-918a-f53113e99ebf service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:03.136427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a710883-227e-487c-918a-f53113e99ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:03.148277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a710883-227e-487c-918a-f53113e99ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:03.152528 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a710883-227e-487c-918a-f53113e99ebf service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:03.182763 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9e522-3b65-4002-abf7-f8dbe45db210 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:03.183077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9e522-3b65-4002-abf7-f8dbe45db210 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:03.183362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9e522-3b65-4002-abf7-f8dbe45db210 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:03.185364 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 821/1655] 10.222.0.44 () {54 vars in 912 bytes} [Mon Feb 28 10:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:38:03.185496 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 834/1655] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:03.192217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780a06b-4b8f-4c61-bdce-d6ac479c354f None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:03.192502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780a06b-4b8f-4c61-bdce-d6ac479c354f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:03.192808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780a06b-4b8f-4c61-bdce-d6ac479c354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:03.255710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-6780a06b-4b8f-4c61-bdce-d6ac479c354f None None] MFA Rules not processed for user `44fb3491570c41cbb7271cfce1c31e39`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:03.256924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6780a06b-4b8f-4c61-bdce-d6ac479c354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:03.361020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 822/1656] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:38:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:03.503052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a710883-227e-487c-918a-f53113e99ebf service nova] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:03.513352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a710883-227e-487c-918a-f53113e99ebf service nova] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:03.518684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214cd5c-fc94-442e-8a55-5b54bceadbe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:03.519366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214cd5c-fc94-442e-8a55-5b54bceadbe3 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:03.520197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214cd5c-fc94-442e-8a55-5b54bceadbe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:03.520197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214cd5c-fc94-442e-8a55-5b54bceadbe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:03.544613 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214cd5c-fc94-442e-8a55-5b54bceadbe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:03.546082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214cd5c-fc94-442e-8a55-5b54bceadbe3 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:03.555218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 835/1657] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:03.759155 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9df6f-2111-4738-8089-15fedf20d26a None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:03.759368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9df6f-2111-4738-8089-15fedf20d26a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:03.761011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9df6f-2111-4738-8089-15fedf20d26a None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:03.764014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 823/1658] 10.222.0.44 () {54 vars in 912 bytes} [Mon Feb 28 10:38:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:38:03.772401 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1789-17a0-48ee-8ca5-ddcb8b067d17 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:03.772972 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1789-17a0-48ee-8ca5-ddcb8b067d17 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:03.773567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1789-17a0-48ee-8ca5-ddcb8b067d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:03.822708 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-799d1789-17a0-48ee-8ca5-ddcb8b067d17 None None] MFA Rules not processed for user `44fb3491570c41cbb7271cfce1c31e39`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:03.824325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-799d1789-17a0-48ee-8ca5-ddcb8b067d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:03.838636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 836/1659] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:38:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:03.873443 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9df6f-2111-4738-8089-15fedf20d26a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:03.910641 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9df6f-2111-4738-8089-15fedf20d26a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:03.924632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188d2f1-99a6-4a73-b3ed-2a4772d37aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:03.926683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188d2f1-99a6-4a73-b3ed-2a4772d37aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:03.928272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188d2f1-99a6-4a73-b3ed-2a4772d37aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:03.929565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188d2f1-99a6-4a73-b3ed-2a4772d37aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:03.952124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188d2f1-99a6-4a73-b3ed-2a4772d37aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:03.953943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188d2f1-99a6-4a73-b3ed-2a4772d37aa5 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:03.971814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 824/1660] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:04.596460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c1c3d-93f9-44d6-8cec-d06ac21877f7 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:04.596962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c1c3d-93f9-44d6-8cec-d06ac21877f7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:04.597075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c1c3d-93f9-44d6-8cec-d06ac21877f7 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:04.598809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 837/1661] 10.222.0.44 () {54 vars in 960 bytes} [Mon Feb 28 10:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:38:04.605037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdda5-3733-4f20-af0c-f055346835eb None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:04.605582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdda5-3733-4f20-af0c-f055346835eb None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:04.605582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdda5-3733-4f20-af0c-f055346835eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:04.667954 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-932bdda5-3733-4f20-af0c-f055346835eb None None] MFA Rules not processed for user `ee30c8013ebb40a99d1eac7820d7f1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:04.673579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-932bdda5-3733-4f20-af0c-f055346835eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:04.879239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 825/1662] 10.222.0.44 () {58 vars in 1057 bytes} [Mon Feb 28 10:38:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:04.886311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c1c3d-93f9-44d6-8cec-d06ac21877f7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:04.909799 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c1c3d-93f9-44d6-8cec-d06ac21877f7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:04.938368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48611630-d5a7-42e9-ac67-71e78bd91f6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee30c8013ebb40a99d1eac7820d7f1f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:04.939133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611630-d5a7-42e9-ac67-71e78bd91f6f service placement] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:04.939350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611630-d5a7-42e9-ac67-71e78bd91f6f service placement] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:04.939983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611630-d5a7-42e9-ac67-71e78bd91f6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:04.959132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-48611630-d5a7-42e9-ac67-71e78bd91f6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:04.996770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48611630-d5a7-42e9-ac67-71e78bd91f6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:05.000659 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48611630-d5a7-42e9-ac67-71e78bd91f6f service placement] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:05.035734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bdda5-3733-4f20-af0c-f055346835eb None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:05.047186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 838/1663] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:05.054780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bdda5-3733-4f20-af0c-f055346835eb None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:05.064792 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2386ad-53ba-4917-8ee4-73535246c756 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee30c8013ebb40a99d1eac7820d7f1f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:05.065598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2386ad-53ba-4917-8ee4-73535246c756 service placement] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:05.065882 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2386ad-53ba-4917-8ee4-73535246c756 service placement] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:05.066154 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2386ad-53ba-4917-8ee4-73535246c756 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:05.092333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2386ad-53ba-4917-8ee4-73535246c756 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:05.098688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2386ad-53ba-4917-8ee4-73535246c756 service placement] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:05.130370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 826/1664] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:07.405792 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8e40e-02f4-4325-9895-08089b1118c2 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:07.407078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8e40e-02f4-4325-9895-08089b1118c2 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:07.407548 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8e40e-02f4-4325-9895-08089b1118c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:07.488034 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2fe8e40e-02f4-4325-9895-08089b1118c2 None None] MFA Rules not processed for user `e8a15e844eba4dd8864ff1fe152d9d63`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:07.489733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2fe8e40e-02f4-4325-9895-08089b1118c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:07.657686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 839/1665] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:07.657858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2386ad-53ba-4917-8ee4-73535246c756 service placement] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:07.681042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2386ad-53ba-4917-8ee4-73535246c756 service placement] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:07.688136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a9ab4-6f19-41f8-98ec-8a0909e655ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:07.688811 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a9ab4-6f19-41f8-98ec-8a0909e655ff service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:07.689093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a9ab4-6f19-41f8-98ec-8a0909e655ff service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:07.689370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a9ab4-6f19-41f8-98ec-8a0909e655ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:07.704376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a9ab4-6f19-41f8-98ec-8a0909e655ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:07.706021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a9ab4-6f19-41f8-98ec-8a0909e655ff service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:07.716652 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 827/1666] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:08.946007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6ea0-79dd-47c6-a581-03da836ca648 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:08.946857 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6ea0-79dd-47c6-a581-03da836ca648 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:08.947392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6ea0-79dd-47c6-a581-03da836ca648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:08.986629 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-3afc6ea0-79dd-47c6-a581-03da836ca648 None None] MFA Rules not processed for user `4d553b919f944c7a80ec345da995fbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:08.988198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3afc6ea0-79dd-47c6-a581-03da836ca648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:09.103368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 840/1667] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:09.117052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775d530-12dc-4877-b3c9-10c163262f6b None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:09.117510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775d530-12dc-4877-b3c9-10c163262f6b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:09.117588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775d530-12dc-4877-b3c9-10c163262f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:09.141627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-f775d530-12dc-4877-b3c9-10c163262f6b None None] MFA Rules not processed for user `4d553b919f944c7a80ec345da995fbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:09.142840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f775d530-12dc-4877-b3c9-10c163262f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:09.161410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 828/1668] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:09.172069 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc6ea0-79dd-47c6-a581-03da836ca648 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:09.185898 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc6ea0-79dd-47c6-a581-03da836ca648 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:09.196503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6919910-e80c-48ac-a863-7856b66048a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:09.197169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6919910-e80c-48ac-a863-7856b66048a5 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:09.197624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6919910-e80c-48ac-a863-7856b66048a5 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:09.197899 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6919910-e80c-48ac-a863-7856b66048a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:09.207251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6919910-e80c-48ac-a863-7856b66048a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:09.210580 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6919910-e80c-48ac-a863-7856b66048a5 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:09.237388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 841/1669] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:09.893713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c742ded-60c2-499b-b9c9-81c98eff83c8 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:09.893999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c742ded-60c2-499b-b9c9-81c98eff83c8 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:09.894272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c742ded-60c2-499b-b9c9-81c98eff83c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:09.934499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0c742ded-60c2-499b-b9c9-81c98eff83c8 None None] MFA Rules not processed for user `e8a15e844eba4dd8864ff1fe152d9d63`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:09.936558 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0c742ded-60c2-499b-b9c9-81c98eff83c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:09.955406 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 829/1670] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:09.989818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50876e65-28f2-45a0-a8ec-379850a25d2c None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:09.990343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50876e65-28f2-45a0-a8ec-379850a25d2c None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:09.990517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50876e65-28f2-45a0-a8ec-379850a25d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:10.017505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-50876e65-28f2-45a0-a8ec-379850a25d2c None None] MFA Rules not processed for user `4d553b919f944c7a80ec345da995fbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:10.019149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-50876e65-28f2-45a0-a8ec-379850a25d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:10.038937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 842/1671] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:17.345719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f16bb-f895-44aa-b37f-e7a1e90bfdbf None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:17.347006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f16bb-f895-44aa-b37f-e7a1e90bfdbf None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:17.347483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f16bb-f895-44aa-b37f-e7a1e90bfdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:17.387570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-d98f16bb-f895-44aa-b37f-e7a1e90bfdbf None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:17.388846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d98f16bb-f895-44aa-b37f-e7a1e90bfdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:17.493284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 830/1672] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:38:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:17.642001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50876e65-28f2-45a0-a8ec-379850a25d2c None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:17.644652 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-50876e65-28f2-45a0-a8ec-379850a25d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:17.776068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50876e65-28f2-45a0-a8ec-379850a25d2c None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:17.790101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4507b3-3682-41a7-bc48-268c6dc0c37f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:17.790736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4507b3-3682-41a7-bc48-268c6dc0c37f service swift] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:17.791472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4507b3-3682-41a7-bc48-268c6dc0c37f service swift] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:17.792042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4507b3-3682-41a7-bc48-268c6dc0c37f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:17.815231 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4507b3-3682-41a7-bc48-268c6dc0c37f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:17.817622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4507b3-3682-41a7-bc48-268c6dc0c37f service swift] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:17.865118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 843/1673] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:38:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:38:18.360709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f16bb-f895-44aa-b37f-e7a1e90bfdbf None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:18.579564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f16bb-f895-44aa-b37f-e7a1e90bfdbf None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:18.596309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:18.597630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:18.598114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:18.598645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] PATH_INFO: `/v3/users/d1ae0d46d51c461994cce6b064445442` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:18.601131 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ae0d46d51c461994cce6b064445442)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:18.607359 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:18.725091 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ae0d46d51c461994cce6b064445442'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:18.726663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ae0d46d51c461994cce6b064445442'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:18.759104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ae0d46d51c461994cce6b064445442'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:18.776615 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ae0d46d51c461994cce6b064445442'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:18.798539 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ae0d46d51c461994cce6b064445442'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:18.812011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 831/1674] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:18 2022] DELETE /identity/v3/users/d1ae0d46d51c461994cce6b064445442 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:18.817281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80a189-dbbf-4081-95b3-b0672bfd9d6a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:18.817830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80a189-dbbf-4081-95b3-b0672bfd9d6a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:18.817830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80a189-dbbf-4081-95b3-b0672bfd9d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:18.839529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-cb80a189-dbbf-4081-95b3-b0672bfd9d6a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:18.841724 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cb80a189-dbbf-4081-95b3-b0672bfd9d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:18.923172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 844/1675] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:19.131797 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:19.134946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:19.264100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9bdb-9998-497c-a2e2-f23a99907af9 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:19.272397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39d1b0-bcc5-421a-a0d6-9461c9064c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:19.272795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39d1b0-bcc5-421a-a0d6-9461c9064c61 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:19.273281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39d1b0-bcc5-421a-a0d6-9461c9064c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:19.274005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39d1b0-bcc5-421a-a0d6-9461c9064c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:19.287480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39d1b0-bcc5-421a-a0d6-9461c9064c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:19.289405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39d1b0-bcc5-421a-a0d6-9461c9064c61 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:19.304724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 832/1676] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:38:19.311492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba788cf-4c36-4df9-97d1-10cd5c037a67 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:19.312020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba788cf-4c36-4df9-97d1-10cd5c037a67 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:19.312484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba788cf-4c36-4df9-97d1-10cd5c037a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:19.333251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-bba788cf-4c36-4df9-97d1-10cd5c037a67 None None] MFA Rules not processed for user `44fb3491570c41cbb7271cfce1c31e39`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:19.335466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-bba788cf-4c36-4df9-97d1-10cd5c037a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:19.347540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 845/1677] 10.222.0.46 () {58 vars in 1015 bytes} [Mon Feb 28 10:38:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:19.429467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39d1b0-bcc5-421a-a0d6-9461c9064c61 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:19.431528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ce39d1b0-bcc5-421a-a0d6-9461c9064c61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:19.447037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39d1b0-bcc5-421a-a0d6-9461c9064c61 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:19.455054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf32e-4f7d-42da-b4dd-5e44fc745368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:19.455990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf32e-4f7d-42da-b4dd-5e44fc745368 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:19.456595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf32e-4f7d-42da-b4dd-5e44fc745368 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:19.457360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf32e-4f7d-42da-b4dd-5e44fc745368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:19.470874 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cf32e-4f7d-42da-b4dd-5e44fc745368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:19.472730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cf32e-4f7d-42da-b4dd-5e44fc745368 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:19.483999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 833/1678] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:19.487219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba788cf-4c36-4df9-97d1-10cd5c037a67 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:19.510662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba788cf-4c36-4df9-97d1-10cd5c037a67 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:19.523166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba54a1c-0ec3-4b63-9060-f47d8561199e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:19.523879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba54a1c-0ec3-4b63-9060-f47d8561199e service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:19.524358 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba54a1c-0ec3-4b63-9060-f47d8561199e service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:19.524834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba54a1c-0ec3-4b63-9060-f47d8561199e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:19.535457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba54a1c-0ec3-4b63-9060-f47d8561199e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:19.538676 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba54a1c-0ec3-4b63-9060-f47d8561199e service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:19.571781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 846/1679] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:38:20.549866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf32e-4f7d-42da-b4dd-5e44fc745368 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:20.551565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-382cf32e-4f7d-42da-b4dd-5e44fc745368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:20.586385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf32e-4f7d-42da-b4dd-5e44fc745368 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:20.592975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:20.593840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:20.594112 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:20.594381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] PATH_INFO: `/v3/projects/12c28d6a93204fbf9adffe45dec819b3` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:20.608025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c28d6a93204fbf9adffe45dec819b3)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:20.609294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: WARNING py.warnings [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:38:20.609294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: warnings.warn(msg) Feb 28 10:38:20.609294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: Feb 28 10:38:20.610492 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:20.740102 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c28d6a93204fbf9adffe45dec819b3', 'request_id': 'req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:20.758345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c28d6a93204fbf9adffe45dec819b3', 'request_id': 'req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:20.814536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c28d6a93204fbf9adffe45dec819b3', 'request_id': 'req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:20.859473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] The token cache is being invalidate because project 12c28d6a93204fbf9adffe45dec819b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:20.859956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:20.860895 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3ab8f72-fd3d-4690-bd74-1f9cf6e48bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:20.863071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 834/1680] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:20 2022] DELETE /identity/v3/projects/12c28d6a93204fbf9adffe45dec819b3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:20.869243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bd973-b2ae-4cf7-bfaa-07f73c2ede6c None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:20.870216 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bd973-b2ae-4cf7-bfaa-07f73c2ede6c None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:20.870643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bd973-b2ae-4cf7-bfaa-07f73c2ede6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:20.911819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2d6bd973-b2ae-4cf7-bfaa-07f73c2ede6c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:20.913343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2d6bd973-b2ae-4cf7-bfaa-07f73c2ede6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:21.072640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 847/1681] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:21.078545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474624d-f312-46d1-9b5c-45b1c2a817c5 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:21.079332 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474624d-f312-46d1-9b5c-45b1c2a817c5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:21.079777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474624d-f312-46d1-9b5c-45b1c2a817c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:21.117890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-7474624d-f312-46d1-9b5c-45b1c2a817c5 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:21.119805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7474624d-f312-46d1-9b5c-45b1c2a817c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:21.145939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 835/1682] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:21.150410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bd973-b2ae-4cf7-bfaa-07f73c2ede6c None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:21.161473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bd973-b2ae-4cf7-bfaa-07f73c2ede6c None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:21.167550 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cb4b-62fe-4fbc-bf8d-e693a3dfc848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:21.168582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cb4b-62fe-4fbc-bf8d-e693a3dfc848 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:21.169782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cb4b-62fe-4fbc-bf8d-e693a3dfc848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:21.170273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cb4b-62fe-4fbc-bf8d-e693a3dfc848 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:21.171225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cb4b-62fe-4fbc-bf8d-e693a3dfc848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:38:21.171877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cb4b-62fe-4fbc-bf8d-e693a3dfc848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:21.174590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cb4b-62fe-4fbc-bf8d-e693a3dfc848 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:21.195279 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474624d-f312-46d1-9b5c-45b1c2a817c5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:21.218363 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 848/1683] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:38:21.220525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474624d-f312-46d1-9b5c-45b1c2a817c5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:21.231065 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212587-9cff-4194-95a3-2fe818a9e427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:21.232568 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212587-9cff-4194-95a3-2fe818a9e427 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:21.233107 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212587-9cff-4194-95a3-2fe818a9e427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:21.233603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212587-9cff-4194-95a3-2fe818a9e427 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:21.234590 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4212587-9cff-4194-95a3-2fe818a9e427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:21.244746 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4212587-9cff-4194-95a3-2fe818a9e427 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:21.308636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cb4b-62fe-4fbc-bf8d-e693a3dfc848 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:21.320196 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 836/1684] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:21 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:21.322978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cb4b-62fe-4fbc-bf8d-e693a3dfc848 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:21.494300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ef66a-d1cb-4f29-a308-3674715309c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:21.496247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef66a-d1cb-4f29-a308-3674715309c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:21.497844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef66a-d1cb-4f29-a308-3674715309c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:21.498279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef66a-d1cb-4f29-a308-3674715309c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:21.499202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ef66a-d1cb-4f29-a308-3674715309c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:21.505812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ef66a-d1cb-4f29-a308-3674715309c0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:21.557309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212587-9cff-4194-95a3-2fe818a9e427 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:21.558166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 849/1685] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:21 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:38:21.571670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212587-9cff-4194-95a3-2fe818a9e427 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:21.590475 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927847f7-ad42-4056-9d94-9adafd94a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:21.591905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927847f7-ad42-4056-9d94-9adafd94a314 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:21.592430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927847f7-ad42-4056-9d94-9adafd94a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:21.593022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927847f7-ad42-4056-9d94-9adafd94a314 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:21.603667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927847f7-ad42-4056-9d94-9adafd94a314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:21.625502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927847f7-ad42-4056-9d94-9adafd94a314 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:21.677090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ef66a-d1cb-4f29-a308-3674715309c0 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:21.692779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ef66a-d1cb-4f29-a308-3674715309c0 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:21.693036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 837/1686] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:21.709449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568039ef-dfd2-4a9d-b8c9-e079e50955da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:21.710198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568039ef-dfd2-4a9d-b8c9-e079e50955da admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:21.710478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568039ef-dfd2-4a9d-b8c9-e079e50955da admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:21.710753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568039ef-dfd2-4a9d-b8c9-e079e50955da admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:21.711516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568039ef-dfd2-4a9d-b8c9-e079e50955da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:21.713122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568039ef-dfd2-4a9d-b8c9-e079e50955da admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:21.745920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 850/1687] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:38:21.748137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927847f7-ad42-4056-9d94-9adafd94a314 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:21.761104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927847f7-ad42-4056-9d94-9adafd94a314 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:21.779176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c34d25-5c41-41de-bf3f-ca40f9a0dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:21.780510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34d25-5c41-41de-bf3f-ca40f9a0dbe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:21.781055 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34d25-5c41-41de-bf3f-ca40f9a0dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:21.781551 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34d25-5c41-41de-bf3f-ca40f9a0dbe6 admin admin] PATH_INFO: `/v3/projects/966e25c9af6d43779ccf0485a5d7a972/users/85a86a34ce3b42ab89d2d67cbfd4777f/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:21.822404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c34d25-5c41-41de-bf3f-ca40f9a0dbe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966e25c9af6d43779ccf0485a5d7a972, user_id=85a86a34ce3b42ab89d2d67cbfd4777f, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:21.825760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c34d25-5c41-41de-bf3f-ca40f9a0dbe6 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:21.863732 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 838/1688] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:21 2022] PUT /identity/v3/projects/966e25c9af6d43779ccf0485a5d7a972/users/85a86a34ce3b42ab89d2d67cbfd4777f/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:21.869331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572169-5b3e-4d39-ae47-5332daf8dae9 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:21.869860 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572169-5b3e-4d39-ae47-5332daf8dae9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:21.869984 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572169-5b3e-4d39-ae47-5332daf8dae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:21.981236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-13572169-5b3e-4d39-ae47-5332daf8dae9 None None] MFA Rules not processed for user `85a86a34ce3b42ab89d2d67cbfd4777f`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:21.989167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-13572169-5b3e-4d39-ae47-5332daf8dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:22.115450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 851/1689] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:22.117480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c34d25-5c41-41de-bf3f-ca40f9a0dbe6 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:22.198512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c34d25-5c41-41de-bf3f-ca40f9a0dbe6 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:22.206214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc1b3b-fa1a-403f-bebc-45d31244fff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:22.207253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1b3b-fa1a-403f-bebc-45d31244fff1 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:22.207989 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1b3b-fa1a-403f-bebc-45d31244fff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:22.208702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1b3b-fa1a-403f-bebc-45d31244fff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:22.210220 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc1b3b-fa1a-403f-bebc-45d31244fff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:22.212857 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc1b3b-fa1a-403f-bebc-45d31244fff1 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:22.261115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13572169-5b3e-4d39-ae47-5332daf8dae9 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:22.263208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 839/1690] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:22 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:22.282697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13572169-5b3e-4d39-ae47-5332daf8dae9 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:22.434728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb8a3b-904b-4099-843f-8734a5c5371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:22.436233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8a3b-904b-4099-843f-8734a5c5371e admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:22.436643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8a3b-904b-4099-843f-8734a5c5371e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:22.437051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8a3b-904b-4099-843f-8734a5c5371e admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:22.437992 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb8a3b-904b-4099-843f-8734a5c5371e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:22.441812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb8a3b-904b-4099-843f-8734a5c5371e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:22.489272 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 852/1691] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:22 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:22.491068 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc1b3b-fa1a-403f-bebc-45d31244fff1 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:22.508938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc1b3b-fa1a-403f-bebc-45d31244fff1 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:22.522269 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a05d56-ad24-41e8-a9be-bc3be89c669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:22.523770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a05d56-ad24-41e8-a9be-bc3be89c669f admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:22.524369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a05d56-ad24-41e8-a9be-bc3be89c669f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:22.524785 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a05d56-ad24-41e8-a9be-bc3be89c669f admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:22.525939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a05d56-ad24-41e8-a9be-bc3be89c669f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:22.529508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a05d56-ad24-41e8-a9be-bc3be89c669f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:22.557040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 840/1692] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:22.558336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb8a3b-904b-4099-843f-8734a5c5371e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:22.593810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb8a3b-904b-4099-843f-8734a5c5371e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:22.617654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a973e8f-dfbe-4b4d-b559-c0191380e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:22.621576 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a973e8f-dfbe-4b4d-b559-c0191380e425 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:22.622788 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a973e8f-dfbe-4b4d-b559-c0191380e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:22.624609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a973e8f-dfbe-4b4d-b559-c0191380e425 admin admin] PATH_INFO: `/v3/projects/7f4e4f95e52c41fea614cc9780d5f90d/users/58cb19ecba90489985f48a9dc7b1faef/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:22.678481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a973e8f-dfbe-4b4d-b559-c0191380e425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4e4f95e52c41fea614cc9780d5f90d, user_id=58cb19ecba90489985f48a9dc7b1faef, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:22.683205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a973e8f-dfbe-4b4d-b559-c0191380e425 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:22.704684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 853/1693] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:22 2022] PUT /identity/v3/projects/7f4e4f95e52c41fea614cc9780d5f90d/users/58cb19ecba90489985f48a9dc7b1faef/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:22.708902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a05d56-ad24-41e8-a9be-bc3be89c669f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:22.720329 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a05d56-ad24-41e8-a9be-bc3be89c669f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:22.854995 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658786ea-6e56-439c-83ad-2ae1bc991c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:22.855728 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658786ea-6e56-439c-83ad-2ae1bc991c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:22.856007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658786ea-6e56-439c-83ad-2ae1bc991c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:22.856259 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658786ea-6e56-439c-83ad-2ae1bc991c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:22.857084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658786ea-6e56-439c-83ad-2ae1bc991c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:22.859151 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658786ea-6e56-439c-83ad-2ae1bc991c44 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:22.871159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 841/1694] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:22.876261 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a973e8f-dfbe-4b4d-b559-c0191380e425 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:22.892491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a973e8f-dfbe-4b4d-b559-c0191380e425 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:22.902068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc206f-e29c-4e95-a6db-8fe9b83cf5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:22.918140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc206f-e29c-4e95-a6db-8fe9b83cf5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:22.918530 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc206f-e29c-4e95-a6db-8fe9b83cf5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:22.919266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc206f-e29c-4e95-a6db-8fe9b83cf5ee admin admin] PATH_INFO: `/v3/projects/7f4e4f95e52c41fea614cc9780d5f90d/users/58cb19ecba90489985f48a9dc7b1faef/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:22.922072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc206f-e29c-4e95-a6db-8fe9b83cf5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4e4f95e52c41fea614cc9780d5f90d, user_id=58cb19ecba90489985f48a9dc7b1faef, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:22.925370 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc206f-e29c-4e95-a6db-8fe9b83cf5ee admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:22.972940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 854/1695] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:22 2022] PUT /identity/v3/projects/7f4e4f95e52c41fea614cc9780d5f90d/users/58cb19ecba90489985f48a9dc7b1faef/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:22.975103 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbf675-df96-4006-aab0-3bb795d1821e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:22.978481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbf675-df96-4006-aab0-3bb795d1821e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:22.978481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbf675-df96-4006-aab0-3bb795d1821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:23.029198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-26cbf675-df96-4006-aab0-3bb795d1821e None None] MFA Rules not processed for user `58cb19ecba90489985f48a9dc7b1faef`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:23.031403 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-26cbf675-df96-4006-aab0-3bb795d1821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:23.175409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a659007-92ae-4075-abc7-dc3bf2598564 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:23.176014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a659007-92ae-4075-abc7-dc3bf2598564 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:23.176474 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a659007-92ae-4075-abc7-dc3bf2598564 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:23.178988 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 855/1696] 10.222.0.44 () {54 vars in 921 bytes} [Mon Feb 28 10:38:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:38:23.233747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 842/1697] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:23.245256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a659007-92ae-4075-abc7-dc3bf2598564 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:23.247671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3a659007-92ae-4075-abc7-dc3bf2598564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:23.291172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd59d6-9430-4fae-aeac-39d1cbd1e47c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:23.291748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd59d6-9430-4fae-aeac-39d1cbd1e47c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:23.292312 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd59d6-9430-4fae-aeac-39d1cbd1e47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:23.331097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-4bdd59d6-9430-4fae-aeac-39d1cbd1e47c None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:23.333174 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-4bdd59d6-9430-4fae-aeac-39d1cbd1e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:23.433416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a659007-92ae-4075-abc7-dc3bf2598564 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:23.470772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d3a76-d5e8-494b-ace8-0df1d330a2e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:23.472538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d3a76-d5e8-494b-ace8-0df1d330a2e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:23.473328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d3a76-d5e8-494b-ace8-0df1d330a2e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:23.473844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d3a76-d5e8-494b-ace8-0df1d330a2e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:23.503536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d3a76-d5e8-494b-ace8-0df1d330a2e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:23.511099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d3a76-d5e8-494b-ace8-0df1d330a2e8 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:23.547151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 856/1698] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:23.552356 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a194-caa1-46f8-ba35-e86639c16de8 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:23.552983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a194-caa1-46f8-ba35-e86639c16de8 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:23.555298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a194-caa1-46f8-ba35-e86639c16de8 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:23.562964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 857/1699] 10.222.0.44 () {54 vars in 921 bytes} [Mon Feb 28 10:38:23 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:38:23.668581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 843/1700] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Feb 28 10:38:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:38:23.786868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc594a-eda3-426a-a695-a2092b5e3638 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:23.787290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc594a-eda3-426a-a695-a2092b5e3638 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:23.787702 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc594a-eda3-426a-a695-a2092b5e3638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:23.795349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd59d6-9430-4fae-aeac-39d1cbd1e47c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:23.811172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd59d6-9430-4fae-aeac-39d1cbd1e47c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:23.815664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe833b-77e9-4f0c-b036-b14c7f4c938b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:23.817356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe833b-77e9-4f0c-b036-b14c7f4c938b service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:23.818189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe833b-77e9-4f0c-b036-b14c7f4c938b service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:23.818662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe833b-77e9-4f0c-b036-b14c7f4c938b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:23.826639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-4dbc594a-eda3-426a-a695-a2092b5e3638 None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:23.828118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4dbc594a-eda3-426a-a695-a2092b5e3638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:23.853078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 858/1701] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Feb 28 10:38:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:23.925587 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe833b-77e9-4f0c-b036-b14c7f4c938b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:23.928389 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe833b-77e9-4f0c-b036-b14c7f4c938b service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:23.975570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 844/1702] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:38:24.770871 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc594a-eda3-426a-a695-a2092b5e3638 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:24.772568 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4dbc594a-eda3-426a-a695-a2092b5e3638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:24.800030 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe833b-77e9-4f0c-b036-b14c7f4c938b service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:24.804999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-8afe833b-77e9-4f0c-b036-b14c7f4c938b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:24.814410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc594a-eda3-426a-a695-a2092b5e3638 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:24.835088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fad686-99b7-4d1b-83b0-b00e3b6fe4bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:24.835810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fad686-99b7-4d1b-83b0-b00e3b6fe4bb service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:24.836122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fad686-99b7-4d1b-83b0-b00e3b6fe4bb service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:24.836401 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fad686-99b7-4d1b-83b0-b00e3b6fe4bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:24.874714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fad686-99b7-4d1b-83b0-b00e3b6fe4bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:24.880662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fad686-99b7-4d1b-83b0-b00e3b6fe4bb service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:24.977078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 859/1703] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:24.988816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fad686-99b7-4d1b-83b0-b00e3b6fe4bb service nova] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:24.996147 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f2fad686-99b7-4d1b-83b0-b00e3b6fe4bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:25.026653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe833b-77e9-4f0c-b036-b14c7f4c938b service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:25.049354 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:25.050743 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:25.052459 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:25.053228 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] PATH_INFO: `/v3/users/42aece3b204948128fd861aaadd0087d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:25.070093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] RBAC: Authorizing `identity:delete_user(user_id=42aece3b204948128fd861aaadd0087d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:25.086338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:25.099169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fad686-99b7-4d1b-83b0-b00e3b6fe4bb service nova] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:25.119404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a014e-ca53-43e2-8701-74fd2afbdf03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:25.120272 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a014e-ca53-43e2-8701-74fd2afbdf03 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:25.120685 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a014e-ca53-43e2-8701-74fd2afbdf03 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:25.121047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a014e-ca53-43e2-8701-74fd2afbdf03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:25.141222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a014e-ca53-43e2-8701-74fd2afbdf03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:25.141222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a014e-ca53-43e2-8701-74fd2afbdf03 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:25.179352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 860/1704] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:25.236723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42aece3b204948128fd861aaadd0087d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:25.237438 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42aece3b204948128fd861aaadd0087d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:25.279871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42aece3b204948128fd861aaadd0087d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:25.301657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42aece3b204948128fd861aaadd0087d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:25.312387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42aece3b204948128fd861aaadd0087d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:25.330742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 845/1705] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:24 2022] DELETE /identity/v3/users/42aece3b204948128fd861aaadd0087d => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:25.335459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb4db-ce2e-4d4d-8073-2aab885328cd None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:25.336053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb4db-ce2e-4d4d-8073-2aab885328cd None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:25.336444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb4db-ce2e-4d4d-8073-2aab885328cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:25.377487 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-94beb4db-ce2e-4d4d-8073-2aab885328cd None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:25.380678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-94beb4db-ce2e-4d4d-8073-2aab885328cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:25.585369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 861/1706] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:25.598197 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:25.599777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:25.793158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7019428-a4a5-4a27-9a9c-6bbfc500827d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:25.798668 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eebc6-4495-4df0-9401-c22fcb3103dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:25.800189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eebc6-4495-4df0-9401-c22fcb3103dd service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:25.800769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eebc6-4495-4df0-9401-c22fcb3103dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:25.800769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eebc6-4495-4df0-9401-c22fcb3103dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:25.815055 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eebc6-4495-4df0-9401-c22fcb3103dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:25.816751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eebc6-4495-4df0-9401-c22fcb3103dd service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:25.861483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 846/1707] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:26.871712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beb4db-ce2e-4d4d-8073-2aab885328cd None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:26.877285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-94beb4db-ce2e-4d4d-8073-2aab885328cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:26.890760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beb4db-ce2e-4d4d-8073-2aab885328cd None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:26.895686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:26.896820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:26.897113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:26.897437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] PATH_INFO: `/v3/projects/4ea56762733b4365a74b1ddc2b4b2045` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:26.898705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea56762733b4365a74b1ddc2b4b2045)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:26.900563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:26.993936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea56762733b4365a74b1ddc2b4b2045', 'request_id': 'req-44962ca2-f294-40f2-b6a8-35a6ebc98262'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:27.008138 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea56762733b4365a74b1ddc2b4b2045', 'request_id': 'req-44962ca2-f294-40f2-b6a8-35a6ebc98262'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:27.017439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea56762733b4365a74b1ddc2b4b2045', 'request_id': 'req-44962ca2-f294-40f2-b6a8-35a6ebc98262'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:27.055039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] The token cache is being invalidate because project 4ea56762733b4365a74b1ddc2b4b2045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:27.058398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:27.060653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-44962ca2-f294-40f2-b6a8-35a6ebc98262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:27.062948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 862/1708] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:26 2022] DELETE /identity/v3/projects/4ea56762733b4365a74b1ddc2b4b2045 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:27.068246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed329-f203-4b1b-9324-42f1d5f4af8c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:27.068845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed329-f203-4b1b-9324-42f1d5f4af8c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:27.068845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed329-f203-4b1b-9324-42f1d5f4af8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:27.115684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-eefed329-f203-4b1b-9324-42f1d5f4af8c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:27.117184 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-eefed329-f203-4b1b-9324-42f1d5f4af8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:27.236013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 847/1709] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:27.243895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529562-167a-41d6-845d-6a25d04709e9 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:27.244206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529562-167a-41d6-845d-6a25d04709e9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:27.244480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529562-167a-41d6-845d-6a25d04709e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:27.266065 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-d0529562-167a-41d6-845d-6a25d04709e9 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:27.267833 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d0529562-167a-41d6-845d-6a25d04709e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:27.294957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 863/1710] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:27.297390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefed329-f203-4b1b-9324-42f1d5f4af8c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:27.319998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefed329-f203-4b1b-9324-42f1d5f4af8c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:27.327138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881f9ea-d184-4a2e-8546-4ee04e81c7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:27.327356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881f9ea-d184-4a2e-8546-4ee04e81c7fb admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:27.328051 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881f9ea-d184-4a2e-8546-4ee04e81c7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:27.328501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881f9ea-d184-4a2e-8546-4ee04e81c7fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:27.329612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881f9ea-d184-4a2e-8546-4ee04e81c7fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:38:27.330120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881f9ea-d184-4a2e-8546-4ee04e81c7fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:27.332024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881f9ea-d184-4a2e-8546-4ee04e81c7fb admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:27.377317 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 848/1711] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:38:27.378201 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0529562-167a-41d6-845d-6a25d04709e9 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:27.384612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881f9ea-d184-4a2e-8546-4ee04e81c7fb admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:27.387664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e881f9ea-d184-4a2e-8546-4ee04e81c7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:27.393953 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0529562-167a-41d6-845d-6a25d04709e9 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:27.414644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d6ef3-d935-46e5-9b21-7b071e33103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:27.415533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d6ef3-d935-46e5-9b21-7b071e33103e admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:27.415732 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881f9ea-d184-4a2e-8546-4ee04e81c7fb admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:27.416707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d6ef3-d935-46e5-9b21-7b071e33103e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:27.416989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d6ef3-d935-46e5-9b21-7b071e33103e admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:27.417919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d6ef3-d935-46e5-9b21-7b071e33103e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:27.425112 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803763e6-f6df-4f3f-9343-f1b8fcc38f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:27.426253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803763e6-f6df-4f3f-9343-f1b8fcc38f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:27.426653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803763e6-f6df-4f3f-9343-f1b8fcc38f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:27.427089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803763e6-f6df-4f3f-9343-f1b8fcc38f57 admin admin] PATH_INFO: `/v3/users/85a86a34ce3b42ab89d2d67cbfd4777f` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:27.438497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803763e6-f6df-4f3f-9343-f1b8fcc38f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a86a34ce3b42ab89d2d67cbfd4777f)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:27.441013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803763e6-f6df-4f3f-9343-f1b8fcc38f57 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:27.459775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d6ef3-d935-46e5-9b21-7b071e33103e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:27.530412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-803763e6-f6df-4f3f-9343-f1b8fcc38f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a86a34ce3b42ab89d2d67cbfd4777f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:27.531921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-803763e6-f6df-4f3f-9343-f1b8fcc38f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a86a34ce3b42ab89d2d67cbfd4777f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:27.561389 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 864/1712] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:27 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:38:27.565178 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d6ef3-d935-46e5-9b21-7b071e33103e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:27.568618 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-803763e6-f6df-4f3f-9343-f1b8fcc38f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a86a34ce3b42ab89d2d67cbfd4777f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:27.570503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d44d6ef3-d935-46e5-9b21-7b071e33103e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:27.587533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-803763e6-f6df-4f3f-9343-f1b8fcc38f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a86a34ce3b42ab89d2d67cbfd4777f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:27.603470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-803763e6-f6df-4f3f-9343-f1b8fcc38f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a86a34ce3b42ab89d2d67cbfd4777f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:27.616510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 849/1713] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:27 2022] DELETE /identity/v3/users/85a86a34ce3b42ab89d2d67cbfd4777f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:27.618144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe07b6b-09c9-486f-8203-fdf064ab5c44 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:27.618574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe07b6b-09c9-486f-8203-fdf064ab5c44 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:27.618864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe07b6b-09c9-486f-8203-fdf064ab5c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:27.641233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ebe07b6b-09c9-486f-8203-fdf064ab5c44 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:27.641578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ebe07b6b-09c9-486f-8203-fdf064ab5c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:27.687737 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d6ef3-d935-46e5-9b21-7b071e33103e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:27.771096 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 850/1714] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:27.784041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe07b6b-09c9-486f-8203-fdf064ab5c44 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:27.787647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ebe07b6b-09c9-486f-8203-fdf064ab5c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:27.795121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652b5e8-033a-4600-aa49-c89476216561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:27.796292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652b5e8-033a-4600-aa49-c89476216561 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:27.796570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652b5e8-033a-4600-aa49-c89476216561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:27.796849 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652b5e8-033a-4600-aa49-c89476216561 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:27.797742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652b5e8-033a-4600-aa49-c89476216561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:27.799710 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652b5e8-033a-4600-aa49-c89476216561 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:27.857913 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 865/1715] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:27 2022] POST /identity/v3/users => generated 283 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:27.863706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652b5e8-033a-4600-aa49-c89476216561 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:27.904952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652b5e8-033a-4600-aa49-c89476216561 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:27.912336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc93d6-51c2-4b74-b9df-9522a1f81d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:27.913030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc93d6-51c2-4b74-b9df-9522a1f81d8d admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:27.913310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc93d6-51c2-4b74-b9df-9522a1f81d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:27.913583 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc93d6-51c2-4b74-b9df-9522a1f81d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:27.914316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc93d6-51c2-4b74-b9df-9522a1f81d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:27.916013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc93d6-51c2-4b74-b9df-9522a1f81d8d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:27.922143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe07b6b-09c9-486f-8203-fdf064ab5c44 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:27.926667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151a3ce-7a2b-48ed-8ff8-568a7f442043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:27.927656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151a3ce-7a2b-48ed-8ff8-568a7f442043 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:27.928381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151a3ce-7a2b-48ed-8ff8-568a7f442043 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:27.929015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151a3ce-7a2b-48ed-8ff8-568a7f442043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:27.929448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 866/1716] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:38:27.940457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc93d6-51c2-4b74-b9df-9522a1f81d8d admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:27.943715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151a3ce-7a2b-48ed-8ff8-568a7f442043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:27.945415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151a3ce-7a2b-48ed-8ff8-568a7f442043 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:27.957525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 851/1717] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:27.980177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc93d6-51c2-4b74-b9df-9522a1f81d8d admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:27.988330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101c4cb-8045-411b-9a83-c125d3768c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:27.991074 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c4cb-8045-411b-9a83-c125d3768c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:27.991297 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c4cb-8045-411b-9a83-c125d3768c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:27.991576 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c4cb-8045-411b-9a83-c125d3768c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:27.992318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101c4cb-8045-411b-9a83-c125d3768c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:27.995133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101c4cb-8045-411b-9a83-c125d3768c58 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:28.006752 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 867/1718] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:28.010822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151a3ce-7a2b-48ed-8ff8-568a7f442043 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:28.025490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151a3ce-7a2b-48ed-8ff8-568a7f442043 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:28.034273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f932627-d3bf-46bc-be8d-8207fae33479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:28.035937 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f932627-d3bf-46bc-be8d-8207fae33479 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:28.036262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f932627-d3bf-46bc-be8d-8207fae33479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:28.036512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f932627-d3bf-46bc-be8d-8207fae33479 admin admin] PATH_INFO: `/v3/projects/969d6d0b517143d792afd1f443bd70e8/users/fb95bbc7951a43e98317b13f123822dc/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:28.060086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f932627-d3bf-46bc-be8d-8207fae33479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969d6d0b517143d792afd1f443bd70e8, user_id=fb95bbc7951a43e98317b13f123822dc, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:28.062856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f932627-d3bf-46bc-be8d-8207fae33479 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:28.111487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 852/1719] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:28 2022] PUT /identity/v3/projects/969d6d0b517143d792afd1f443bd70e8/users/fb95bbc7951a43e98317b13f123822dc/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:28.128190 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94808a07-262f-4da9-b551-15b9c0008ae5 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:28.128796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94808a07-262f-4da9-b551-15b9c0008ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:28.129269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94808a07-262f-4da9-b551-15b9c0008ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:28.181267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-94808a07-262f-4da9-b551-15b9c0008ae5 None None] MFA Rules not processed for user `fb95bbc7951a43e98317b13f123822dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:28.182623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-94808a07-262f-4da9-b551-15b9c0008ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:28.293456 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 868/1720] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:28.312527 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f932627-d3bf-46bc-be8d-8207fae33479 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:28.315011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0f932627-d3bf-46bc-be8d-8207fae33479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:28.369465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94808a07-262f-4da9-b551-15b9c0008ae5 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:28.370961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-94808a07-262f-4da9-b551-15b9c0008ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:28.393611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f932627-d3bf-46bc-be8d-8207fae33479 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:28.397265 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed3a62-88d2-4025-93ba-70995bbd4a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:28.398036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed3a62-88d2-4025-93ba-70995bbd4a41 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:28.398212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed3a62-88d2-4025-93ba-70995bbd4a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:28.398654 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed3a62-88d2-4025-93ba-70995bbd4a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:28.407361 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed3a62-88d2-4025-93ba-70995bbd4a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:28.408922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed3a62-88d2-4025-93ba-70995bbd4a41 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:28.418011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 853/1721] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:28.446796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94808a07-262f-4da9-b551-15b9c0008ae5 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:28.451929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:28.453048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:28.453333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:28.453669 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] PATH_INFO: `/v3/projects/966e25c9af6d43779ccf0485a5d7a972` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:28.454790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=966e25c9af6d43779ccf0485a5d7a972)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:28.456712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:28.504633 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966e25c9af6d43779ccf0485a5d7a972', 'request_id': 'req-db62a03e-2e71-413c-89cc-0d3acf28a41d'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:28.510135 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966e25c9af6d43779ccf0485a5d7a972', 'request_id': 'req-db62a03e-2e71-413c-89cc-0d3acf28a41d'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:28.517027 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966e25c9af6d43779ccf0485a5d7a972', 'request_id': 'req-db62a03e-2e71-413c-89cc-0d3acf28a41d'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:28.531481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] The token cache is being invalidate because project 966e25c9af6d43779ccf0485a5d7a972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:28.532299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:28.533104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:28.534682 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 869/1722] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:28 2022] DELETE /identity/v3/projects/966e25c9af6d43779ccf0485a5d7a972 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:28.538795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed3a62-88d2-4025-93ba-70995bbd4a41 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:28.549864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed3a62-88d2-4025-93ba-70995bbd4a41 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:28.618187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591f455-8f5e-4ede-8a97-c65c4d7174cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:28.619642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591f455-8f5e-4ede-8a97-c65c4d7174cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:28.620263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591f455-8f5e-4ede-8a97-c65c4d7174cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:28.620770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591f455-8f5e-4ede-8a97-c65c4d7174cf admin admin] PATH_INFO: `/v3/users/58cb19ecba90489985f48a9dc7b1faef` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:28.622938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591f455-8f5e-4ede-8a97-c65c4d7174cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=58cb19ecba90489985f48a9dc7b1faef)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:28.626380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591f455-8f5e-4ede-8a97-c65c4d7174cf admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:28.690173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2591f455-8f5e-4ede-8a97-c65c4d7174cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58cb19ecba90489985f48a9dc7b1faef'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:28.690892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2591f455-8f5e-4ede-8a97-c65c4d7174cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58cb19ecba90489985f48a9dc7b1faef'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:28.706407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2591f455-8f5e-4ede-8a97-c65c4d7174cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58cb19ecba90489985f48a9dc7b1faef'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:28.717841 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2591f455-8f5e-4ede-8a97-c65c4d7174cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58cb19ecba90489985f48a9dc7b1faef'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:28.725768 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2591f455-8f5e-4ede-8a97-c65c4d7174cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58cb19ecba90489985f48a9dc7b1faef'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:28.732057 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 854/1723] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:28 2022] DELETE /identity/v3/users/58cb19ecba90489985f48a9dc7b1faef => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:29.140525 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:29.141969 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:29.170514 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62a03e-2e71-413c-89cc-0d3acf28a41d admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:29.233610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:29.234468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:29.234750 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:29.235056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] PATH_INFO: `/v3/projects/7f4e4f95e52c41fea614cc9780d5f90d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:29.236259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4e4f95e52c41fea614cc9780d5f90d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:29.238348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:29.284089 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4e4f95e52c41fea614cc9780d5f90d', 'request_id': 'req-b374a464-b555-4417-bd0d-13f82d2cbb10'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:29.289379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4e4f95e52c41fea614cc9780d5f90d', 'request_id': 'req-b374a464-b555-4417-bd0d-13f82d2cbb10'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:29.296038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4e4f95e52c41fea614cc9780d5f90d', 'request_id': 'req-b374a464-b555-4417-bd0d-13f82d2cbb10'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:29.308396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] The token cache is being invalidate because project 7f4e4f95e52c41fea614cc9780d5f90d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:29.308687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:29.309855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b374a464-b555-4417-bd0d-13f82d2cbb10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:29.311439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 870/1724] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:29 2022] DELETE /identity/v3/projects/7f4e4f95e52c41fea614cc9780d5f90d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:29.316206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d1b7a-50ca-4935-96d1-f7ac40e54042 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:29.316660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d1b7a-50ca-4935-96d1-f7ac40e54042 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:29.316756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d1b7a-50ca-4935-96d1-f7ac40e54042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:29.335591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-934d1b7a-50ca-4935-96d1-f7ac40e54042 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:29.336984 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-934d1b7a-50ca-4935-96d1-f7ac40e54042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:29.412864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 855/1725] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:29.417211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3575f0-df6e-4368-a053-bfb667cfa1d4 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:29.417610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3575f0-df6e-4368-a053-bfb667cfa1d4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:29.417984 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3575f0-df6e-4368-a053-bfb667cfa1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:29.437434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-dc3575f0-df6e-4368-a053-bfb667cfa1d4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:29.438716 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-dc3575f0-df6e-4368-a053-bfb667cfa1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:29.446518 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 871/1726] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:29.450864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d1b7a-50ca-4935-96d1-f7ac40e54042 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:29.460323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d1b7a-50ca-4935-96d1-f7ac40e54042 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:29.464781 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d996c-1d7b-4a95-9cf4-c6ef3c711afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:29.465446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d996c-1d7b-4a95-9cf4-c6ef3c711afb admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:29.465772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d996c-1d7b-4a95-9cf4-c6ef3c711afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:29.466049 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d996c-1d7b-4a95-9cf4-c6ef3c711afb admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:29.466751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d996c-1d7b-4a95-9cf4-c6ef3c711afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:38:29.467078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d996c-1d7b-4a95-9cf4-c6ef3c711afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:29.468655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d996c-1d7b-4a95-9cf4-c6ef3c711afb admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:29.479993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 856/1727] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:38:29.485062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3575f0-df6e-4368-a053-bfb667cfa1d4 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:29.494263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3575f0-df6e-4368-a053-bfb667cfa1d4 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:29.499633 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc3713-e851-40d7-aae6-b97e52877603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:29.500276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc3713-e851-40d7-aae6-b97e52877603 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:29.500551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc3713-e851-40d7-aae6-b97e52877603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:29.500825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc3713-e851-40d7-aae6-b97e52877603 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:29.501516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc3713-e851-40d7-aae6-b97e52877603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:29.503414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc3713-e851-40d7-aae6-b97e52877603 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:29.532274 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 872/1728] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:29 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:29.533620 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d996c-1d7b-4a95-9cf4-c6ef3c711afb admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:29.543347 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d996c-1d7b-4a95-9cf4-c6ef3c711afb admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:29.600182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3447f6-70b1-4856-a755-3fa42125176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:29.600902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3447f6-70b1-4856-a755-3fa42125176c admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:29.601183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3447f6-70b1-4856-a755-3fa42125176c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:29.601454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3447f6-70b1-4856-a755-3fa42125176c admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:29.602194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3447f6-70b1-4856-a755-3fa42125176c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:29.604314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3447f6-70b1-4856-a755-3fa42125176c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:29.624201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 857/1729] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:29 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:29.627999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc3713-e851-40d7-aae6-b97e52877603 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:29.638072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc3713-e851-40d7-aae6-b97e52877603 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:29.642558 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f480b-da71-4c76-97fe-bf7db7429706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:29.643227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f480b-da71-4c76-97fe-bf7db7429706 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:29.643502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f480b-da71-4c76-97fe-bf7db7429706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:29.643776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f480b-da71-4c76-97fe-bf7db7429706 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:29.644483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f480b-da71-4c76-97fe-bf7db7429706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:29.646047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f480b-da71-4c76-97fe-bf7db7429706 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:29.656993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 873/1730] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:29.660869 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3447f6-70b1-4856-a755-3fa42125176c admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:29.671428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3447f6-70b1-4856-a755-3fa42125176c admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:29.675960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9588a-781e-4a2d-b259-3baf44210a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:29.676600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9588a-781e-4a2d-b259-3baf44210a29 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:29.676880 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9588a-781e-4a2d-b259-3baf44210a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:29.677155 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9588a-781e-4a2d-b259-3baf44210a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:29.677866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9588a-781e-4a2d-b259-3baf44210a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:29.679497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9588a-781e-4a2d-b259-3baf44210a29 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:29.689924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 858/1731] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:29.693952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f480b-da71-4c76-97fe-bf7db7429706 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:29.703555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f480b-da71-4c76-97fe-bf7db7429706 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:29.708094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ded760-46ed-42b5-9ca6-d817c6ea2e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:29.708944 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ded760-46ed-42b5-9ca6-d817c6ea2e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:29.709221 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ded760-46ed-42b5-9ca6-d817c6ea2e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:29.709492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ded760-46ed-42b5-9ca6-d817c6ea2e23 admin admin] PATH_INFO: `/v3/projects/7c51f8827e214ea395ef5f10f3d266f8/users/12d8a8a178aa4a8a8412094b4ae9b34c/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:29.723977 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ded760-46ed-42b5-9ca6-d817c6ea2e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c51f8827e214ea395ef5f10f3d266f8, user_id=12d8a8a178aa4a8a8412094b4ae9b34c, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:29.726626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ded760-46ed-42b5-9ca6-d817c6ea2e23 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:29.739695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 874/1732] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:29 2022] PUT /identity/v3/projects/7c51f8827e214ea395ef5f10f3d266f8/users/12d8a8a178aa4a8a8412094b4ae9b34c/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:29.751962 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c9f4-0a20-416e-99af-0f6070eaa936 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:29.752251 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c9f4-0a20-416e-99af-0f6070eaa936 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:29.752524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c9f4-0a20-416e-99af-0f6070eaa936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:29.779699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-9ba8c9f4-0a20-416e-99af-0f6070eaa936 None None] MFA Rules not processed for user `12d8a8a178aa4a8a8412094b4ae9b34c`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:29.780969 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9ba8c9f4-0a20-416e-99af-0f6070eaa936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:29.842967 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 859/1733] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:38:29.847502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ded760-46ed-42b5-9ca6-d817c6ea2e23 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:29.914678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ded760-46ed-42b5-9ca6-d817c6ea2e23 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:29.919812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f4f6c-55b0-43ba-ab1f-1f3cb8c762d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:29.920460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f4f6c-55b0-43ba-ab1f-1f3cb8c762d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:29.920742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f4f6c-55b0-43ba-ab1f-1f3cb8c762d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:29.921010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f4f6c-55b0-43ba-ab1f-1f3cb8c762d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:29.921694 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f4f6c-55b0-43ba-ab1f-1f3cb8c762d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:29.923607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f4f6c-55b0-43ba-ab1f-1f3cb8c762d9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:29.948879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 875/1734] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:29 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:29.954151 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8c9f4-0a20-416e-99af-0f6070eaa936 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:29.967348 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8c9f4-0a20-416e-99af-0f6070eaa936 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:30.036536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803382e-c092-4910-8b15-0c3aa9cfb332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:30.037206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803382e-c092-4910-8b15-0c3aa9cfb332 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:30.037479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803382e-c092-4910-8b15-0c3aa9cfb332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:30.037739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803382e-c092-4910-8b15-0c3aa9cfb332 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:30.038427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803382e-c092-4910-8b15-0c3aa9cfb332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:30.040347 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803382e-c092-4910-8b15-0c3aa9cfb332 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:30.063881 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 860/1735] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:29 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:38:30.065345 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f4f6c-55b0-43ba-ab1f-1f3cb8c762d9 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:30.085107 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f4f6c-55b0-43ba-ab1f-1f3cb8c762d9 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:30.094390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f6ee6-a4bb-4066-ab3f-4d5f9558bd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:30.095427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6ee6-a4bb-4066-ab3f-4d5f9558bd7e admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:30.095743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6ee6-a4bb-4066-ab3f-4d5f9558bd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:30.096184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6ee6-a4bb-4066-ab3f-4d5f9558bd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:30.097047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f6ee6-a4bb-4066-ab3f-4d5f9558bd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:30.098741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f6ee6-a4bb-4066-ab3f-4d5f9558bd7e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:30.121499 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 876/1736] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:30.121842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803382e-c092-4910-8b15-0c3aa9cfb332 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:30.134246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803382e-c092-4910-8b15-0c3aa9cfb332 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:30.140586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59aff4-5472-4579-bfa4-5253ef991e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:30.141899 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59aff4-5472-4579-bfa4-5253ef991e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:30.142248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59aff4-5472-4579-bfa4-5253ef991e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:30.142599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59aff4-5472-4579-bfa4-5253ef991e64 admin admin] PATH_INFO: `/v3/projects/33c194c82fb84c249c232bbac0d3040e/users/be54e00a985e4a508e9cc0c989dc3f36/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:30.167106 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59aff4-5472-4579-bfa4-5253ef991e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c194c82fb84c249c232bbac0d3040e, user_id=be54e00a985e4a508e9cc0c989dc3f36, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:30.169872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59aff4-5472-4579-bfa4-5253ef991e64 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:30.183462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 861/1737] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:30 2022] PUT /identity/v3/projects/33c194c82fb84c249c232bbac0d3040e/users/be54e00a985e4a508e9cc0c989dc3f36/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:30.187700 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f6ee6-a4bb-4066-ab3f-4d5f9558bd7e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:30.197932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f6ee6-a4bb-4066-ab3f-4d5f9558bd7e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:30.261795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86bab-40f8-4d02-a383-665b184db8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:30.263001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86bab-40f8-4d02-a383-665b184db8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:30.263283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86bab-40f8-4d02-a383-665b184db8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:30.263552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86bab-40f8-4d02-a383-665b184db8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:30.264260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f86bab-40f8-4d02-a383-665b184db8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:30.265848 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f86bab-40f8-4d02-a383-665b184db8c2 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:30.275688 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 877/1738] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:30.280514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59aff4-5472-4579-bfa4-5253ef991e64 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:30.290814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59aff4-5472-4579-bfa4-5253ef991e64 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:30.295694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade6404-c66e-4f57-b1ec-efd8ec81a164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:30.296642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade6404-c66e-4f57-b1ec-efd8ec81a164 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:30.297288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade6404-c66e-4f57-b1ec-efd8ec81a164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:30.297288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade6404-c66e-4f57-b1ec-efd8ec81a164 admin admin] PATH_INFO: `/v3/projects/33c194c82fb84c249c232bbac0d3040e/users/be54e00a985e4a508e9cc0c989dc3f36/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:30.299384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade6404-c66e-4f57-b1ec-efd8ec81a164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c194c82fb84c249c232bbac0d3040e, user_id=be54e00a985e4a508e9cc0c989dc3f36, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:30.302073 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade6404-c66e-4f57-b1ec-efd8ec81a164 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:30.313151 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 862/1739] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:30 2022] PUT /identity/v3/projects/33c194c82fb84c249c232bbac0d3040e/users/be54e00a985e4a508e9cc0c989dc3f36/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:30.323065 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386228b6-3b67-4607-ab4c-eb60d25854df None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:30.323360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386228b6-3b67-4607-ab4c-eb60d25854df None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:30.323643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386228b6-3b67-4607-ab4c-eb60d25854df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:30.350601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-386228b6-3b67-4607-ab4c-eb60d25854df None None] MFA Rules not processed for user `be54e00a985e4a508e9cc0c989dc3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:30.351835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-386228b6-3b67-4607-ab4c-eb60d25854df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:30.418245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 878/1740] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:30.429807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade6404-c66e-4f57-b1ec-efd8ec81a164 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:30.431791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6ade6404-c66e-4f57-b1ec-efd8ec81a164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:30.491813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade6404-c66e-4f57-b1ec-efd8ec81a164 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:30.495424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01362866-8eed-4453-b8c8-f4ff557975b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:30.496058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01362866-8eed-4453-b8c8-f4ff557975b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:30.496340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01362866-8eed-4453-b8c8-f4ff557975b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:30.497134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01362866-8eed-4453-b8c8-f4ff557975b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:30.506235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01362866-8eed-4453-b8c8-f4ff557975b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:30.508352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01362866-8eed-4453-b8c8-f4ff557975b6 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:30.518316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 863/1741] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:30.598606 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386228b6-3b67-4607-ab4c-eb60d25854df None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:30.608593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386228b6-3b67-4607-ab4c-eb60d25854df None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:30.612523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d551d-8334-4594-946b-5e3e6997a11a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:30.613267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d551d-8334-4594-946b-5e3e6997a11a service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:30.613455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d551d-8334-4594-946b-5e3e6997a11a service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:30.613698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d551d-8334-4594-946b-5e3e6997a11a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:30.680278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d551d-8334-4594-946b-5e3e6997a11a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:30.681697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d551d-8334-4594-946b-5e3e6997a11a service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:30.691386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 879/1742] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:32.532452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01362866-8eed-4453-b8c8-f4ff557975b6 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:32.534817 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-01362866-8eed-4453-b8c8-f4ff557975b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:32.658257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01362866-8eed-4453-b8c8-f4ff557975b6 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:32.663623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:32.664442 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:32.665076 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:32.665076 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] PATH_INFO: `/v3/users/3fb5b835349e4b549f9e6fff509bd4c0` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:32.666480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb5b835349e4b549f9e6fff509bd4c0)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:32.690237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:32.760213 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb5b835349e4b549f9e6fff509bd4c0'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:32.761041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb5b835349e4b549f9e6fff509bd4c0'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:32.774368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb5b835349e4b549f9e6fff509bd4c0'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:32.783878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb5b835349e4b549f9e6fff509bd4c0'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:32.791170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb5b835349e4b549f9e6fff509bd4c0'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:32.800570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 864/1743] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:32 2022] DELETE /identity/v3/users/3fb5b835349e4b549f9e6fff509bd4c0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:32.804781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6efde-8ac4-4eb4-b9f9-fa0638ec36e4 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:32.805229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6efde-8ac4-4eb4-b9f9-fa0638ec36e4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:32.805343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6efde-8ac4-4eb4-b9f9-fa0638ec36e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:32.823375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-d8c6efde-8ac4-4eb4-b9f9-fa0638ec36e4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:32.824873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d8c6efde-8ac4-4eb4-b9f9-fa0638ec36e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:32.916392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 880/1744] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:32.931865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:32.933584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:33.044283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a44dcf-b229-4c43-9265-6c65366142e9 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:33.070810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8cadf-c826-4156-a5a6-fda6754900f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:33.071919 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8cadf-c826-4156-a5a6-fda6754900f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:33.074293 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8cadf-c826-4156-a5a6-fda6754900f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:33.074293 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8cadf-c826-4156-a5a6-fda6754900f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:33.098113 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8cadf-c826-4156-a5a6-fda6754900f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:33.099891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8cadf-c826-4156-a5a6-fda6754900f1 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:33.127130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 865/1745] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:33.826638 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6efde-8ac4-4eb4-b9f9-fa0638ec36e4 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:33.828348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d8c6efde-8ac4-4eb4-b9f9-fa0638ec36e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:33.844882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6efde-8ac4-4eb4-b9f9-fa0638ec36e4 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:33.852321 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:33.853418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:33.854159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:33.866271 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] PATH_INFO: `/v3/projects/c464215d373b445b8cb286adc7e13360` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:33.871399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c464215d373b445b8cb286adc7e13360)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:33.876435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:33.925707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c464215d373b445b8cb286adc7e13360', 'request_id': 'req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:33.931426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c464215d373b445b8cb286adc7e13360', 'request_id': 'req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:33.938406 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c464215d373b445b8cb286adc7e13360', 'request_id': 'req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:33.951464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] The token cache is being invalidate because project c464215d373b445b8cb286adc7e13360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:33.951834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:33.952552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:33.954152 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 881/1746] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:33 2022] DELETE /identity/v3/projects/c464215d373b445b8cb286adc7e13360 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:33.958149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8cadf-c826-4156-a5a6-fda6754900f1 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:33.973161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8cadf-c826-4156-a5a6-fda6754900f1 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:34.033288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd5b69-61fe-4acc-b62b-bde9f5652e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:34.034208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5b69-61fe-4acc-b62b-bde9f5652e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:34.034554 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5b69-61fe-4acc-b62b-bde9f5652e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:34.034910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5b69-61fe-4acc-b62b-bde9f5652e27 admin admin] PATH_INFO: `/v3/users/747e765f6be140ae9a4708031d290f77` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:34.036237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd5b69-61fe-4acc-b62b-bde9f5652e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747e765f6be140ae9a4708031d290f77)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:34.038414 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd5b69-61fe-4acc-b62b-bde9f5652e27 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:34.095333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-30dd5b69-61fe-4acc-b62b-bde9f5652e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747e765f6be140ae9a4708031d290f77'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:34.096000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-30dd5b69-61fe-4acc-b62b-bde9f5652e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747e765f6be140ae9a4708031d290f77'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:34.108577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-30dd5b69-61fe-4acc-b62b-bde9f5652e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747e765f6be140ae9a4708031d290f77'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:34.115241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-30dd5b69-61fe-4acc-b62b-bde9f5652e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747e765f6be140ae9a4708031d290f77'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:34.122172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-30dd5b69-61fe-4acc-b62b-bde9f5652e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747e765f6be140ae9a4708031d290f77'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:34.128561 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 866/1747] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:33 2022] DELETE /identity/v3/users/747e765f6be140ae9a4708031d290f77 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:34.400427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:34.402273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:34.416723 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f7b85-e330-4918-8cb6-f4e986f08fe9 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:34.480680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:34.481579 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:34.481847 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:34.482280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] PATH_INFO: `/v3/projects/80c92daa914d4271828dafc1cc33dbeb` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:34.483548 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c92daa914d4271828dafc1cc33dbeb)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:34.485481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:34.536082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c92daa914d4271828dafc1cc33dbeb', 'request_id': 'req-b948a834-00a1-4c1f-8572-a9b9dafd2b94'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:34.541390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c92daa914d4271828dafc1cc33dbeb', 'request_id': 'req-b948a834-00a1-4c1f-8572-a9b9dafd2b94'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:34.547599 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c92daa914d4271828dafc1cc33dbeb', 'request_id': 'req-b948a834-00a1-4c1f-8572-a9b9dafd2b94'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:34.559851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] The token cache is being invalidate because project 80c92daa914d4271828dafc1cc33dbeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:34.560140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:34.560794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b948a834-00a1-4c1f-8572-a9b9dafd2b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:34.562488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 882/1748] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:34 2022] DELETE /identity/v3/projects/80c92daa914d4271828dafc1cc33dbeb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:34.567503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911ef6e-9c76-46c9-8a46-4ae59ecd03c9 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:34.567794 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911ef6e-9c76-46c9-8a46-4ae59ecd03c9 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:34.568099 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911ef6e-9c76-46c9-8a46-4ae59ecd03c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:34.586237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-3911ef6e-9c76-46c9-8a46-4ae59ecd03c9 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:34.587471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3911ef6e-9c76-46c9-8a46-4ae59ecd03c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:34.661194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 867/1749] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:34.672488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d33f-f8c6-4227-96e3-6852f58c9589 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:34.672776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d33f-f8c6-4227-96e3-6852f58c9589 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:34.673079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d33f-f8c6-4227-96e3-6852f58c9589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:34.696782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-0d93d33f-f8c6-4227-96e3-6852f58c9589 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:34.698500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0d93d33f-f8c6-4227-96e3-6852f58c9589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:34.708157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 883/1750] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:34.712052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911ef6e-9c76-46c9-8a46-4ae59ecd03c9 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:34.726053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911ef6e-9c76-46c9-8a46-4ae59ecd03c9 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:34.738235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fcc64-a696-4aa0-8092-e20fcac0bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:34.739081 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fcc64-a696-4aa0-8092-e20fcac0bab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:34.739361 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fcc64-a696-4aa0-8092-e20fcac0bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:34.739633 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fcc64-a696-4aa0-8092-e20fcac0bab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:34.740369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fcc64-a696-4aa0-8092-e20fcac0bab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:38:34.740671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fcc64-a696-4aa0-8092-e20fcac0bab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:34.742284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fcc64-a696-4aa0-8092-e20fcac0bab4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:34.761663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 868/1751] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:38:34.767045 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93d33f-f8c6-4227-96e3-6852f58c9589 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:34.777679 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93d33f-f8c6-4227-96e3-6852f58c9589 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:34.784123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf5742-2499-4820-8277-7c59a028f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:34.784980 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf5742-2499-4820-8277-7c59a028f1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:34.785432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf5742-2499-4820-8277-7c59a028f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:34.785935 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf5742-2499-4820-8277-7c59a028f1b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:34.786792 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf5742-2499-4820-8277-7c59a028f1b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:34.789267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf5742-2499-4820-8277-7c59a028f1b0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:34.818092 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 884/1752] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:34 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:34.821768 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fcc64-a696-4aa0-8092-e20fcac0bab4 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:34.832682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fcc64-a696-4aa0-8092-e20fcac0bab4 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:34.903523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848f594-0e65-4500-8dfa-6330631db448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:34.904215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f594-0e65-4500-8dfa-6330631db448 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:34.904494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f594-0e65-4500-8dfa-6330631db448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:34.904779 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f594-0e65-4500-8dfa-6330631db448 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:34.905473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848f594-0e65-4500-8dfa-6330631db448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:34.915358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848f594-0e65-4500-8dfa-6330631db448 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:34.941763 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 869/1753] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:34 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:34.946267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf5742-2499-4820-8277-7c59a028f1b0 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:34.965130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf5742-2499-4820-8277-7c59a028f1b0 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:34.965130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0a9da-f180-4907-91a2-1dc07ec9f834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:34.965130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0a9da-f180-4907-91a2-1dc07ec9f834 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:34.965130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0a9da-f180-4907-91a2-1dc07ec9f834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:34.965577 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0a9da-f180-4907-91a2-1dc07ec9f834 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:34.965577 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0a9da-f180-4907-91a2-1dc07ec9f834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:34.966491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0a9da-f180-4907-91a2-1dc07ec9f834 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:34.977816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 885/1754] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:34.982115 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848f594-0e65-4500-8dfa-6330631db448 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:34.993608 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848f594-0e65-4500-8dfa-6330631db448 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:34.999467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e4656-e8fa-47cc-b0c7-da873c57c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:35.000237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e4656-e8fa-47cc-b0c7-da873c57c076 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:35.000590 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e4656-e8fa-47cc-b0c7-da873c57c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:35.000938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e4656-e8fa-47cc-b0c7-da873c57c076 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:35.001757 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e4656-e8fa-47cc-b0c7-da873c57c076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:35.003570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e4656-e8fa-47cc-b0c7-da873c57c076 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:35.016566 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 870/1755] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:35.020684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0a9da-f180-4907-91a2-1dc07ec9f834 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:35.031180 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0a9da-f180-4907-91a2-1dc07ec9f834 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:35.036168 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db81717-aaca-40bf-8cf1-85b8f91edbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:35.037201 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db81717-aaca-40bf-8cf1-85b8f91edbd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:35.037560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db81717-aaca-40bf-8cf1-85b8f91edbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:35.037910 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db81717-aaca-40bf-8cf1-85b8f91edbd7 admin admin] PATH_INFO: `/v3/projects/7690f0be654d469c9bbdf16d823ac6ad/users/b34f50dc30c146aebb86ae05a365fb8e/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:35.057214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db81717-aaca-40bf-8cf1-85b8f91edbd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7690f0be654d469c9bbdf16d823ac6ad, user_id=b34f50dc30c146aebb86ae05a365fb8e, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:35.060473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db81717-aaca-40bf-8cf1-85b8f91edbd7 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:35.077923 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 886/1756] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:35 2022] PUT /identity/v3/projects/7690f0be654d469c9bbdf16d823ac6ad/users/b34f50dc30c146aebb86ae05a365fb8e/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:35.091863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab7c69-505f-4ae7-8eee-1ee67c16cfa6 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:35.092126 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab7c69-505f-4ae7-8eee-1ee67c16cfa6 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:35.092586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab7c69-505f-4ae7-8eee-1ee67c16cfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:35.134878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-3eab7c69-505f-4ae7-8eee-1ee67c16cfa6 None None] MFA Rules not processed for user `b34f50dc30c146aebb86ae05a365fb8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:35.136148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3eab7c69-505f-4ae7-8eee-1ee67c16cfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:35.213633 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 871/1757] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:35.218103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db81717-aaca-40bf-8cf1-85b8f91edbd7 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:35.311289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db81717-aaca-40bf-8cf1-85b8f91edbd7 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:35.317821 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d5b2f-ba14-4db5-b818-491c558dfa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:35.318585 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d5b2f-ba14-4db5-b818-491c558dfa98 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:35.319134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d5b2f-ba14-4db5-b818-491c558dfa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:35.319608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d5b2f-ba14-4db5-b818-491c558dfa98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:35.320522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d5b2f-ba14-4db5-b818-491c558dfa98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:35.322807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d5b2f-ba14-4db5-b818-491c558dfa98 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:35.368025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 887/1758] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:35 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:38:35.374488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab7c69-505f-4ae7-8eee-1ee67c16cfa6 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:35.389080 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab7c69-505f-4ae7-8eee-1ee67c16cfa6 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:35.478286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933931a-3c33-4fd7-a8eb-f9218385b66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:35.479236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933931a-3c33-4fd7-a8eb-f9218385b66f admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:35.479792 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933931a-3c33-4fd7-a8eb-f9218385b66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:35.480243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933931a-3c33-4fd7-a8eb-f9218385b66f admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:35.481610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933931a-3c33-4fd7-a8eb-f9218385b66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:35.483878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933931a-3c33-4fd7-a8eb-f9218385b66f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:35.516410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 872/1759] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:35 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:35.518076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d5b2f-ba14-4db5-b818-491c558dfa98 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:35.532280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d5b2f-ba14-4db5-b818-491c558dfa98 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:35.539121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afed27-5cd7-4b3c-8602-b0542efa13c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:35.539121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afed27-5cd7-4b3c-8602-b0542efa13c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:35.539121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afed27-5cd7-4b3c-8602-b0542efa13c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:35.539121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afed27-5cd7-4b3c-8602-b0542efa13c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:35.539400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afed27-5cd7-4b3c-8602-b0542efa13c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:35.540633 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afed27-5cd7-4b3c-8602-b0542efa13c9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:35.557021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 888/1760] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:38:35.563531 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933931a-3c33-4fd7-a8eb-f9218385b66f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:35.573675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933931a-3c33-4fd7-a8eb-f9218385b66f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:35.578399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f71f0-8b71-4a1d-8df8-196d1dffba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:35.579304 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f71f0-8b71-4a1d-8df8-196d1dffba96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:35.579582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f71f0-8b71-4a1d-8df8-196d1dffba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:35.579921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f71f0-8b71-4a1d-8df8-196d1dffba96 admin admin] PATH_INFO: `/v3/projects/25939ca7165e485484b879205576e8d4/users/e3ea636f010845b491d5b06ec67411bd/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:35.595583 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f71f0-8b71-4a1d-8df8-196d1dffba96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25939ca7165e485484b879205576e8d4, user_id=e3ea636f010845b491d5b06ec67411bd, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:35.598338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f71f0-8b71-4a1d-8df8-196d1dffba96 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:35.615174 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 873/1761] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:35 2022] PUT /identity/v3/projects/25939ca7165e485484b879205576e8d4/users/e3ea636f010845b491d5b06ec67411bd/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:35.619014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afed27-5cd7-4b3c-8602-b0542efa13c9 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:35.629154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afed27-5cd7-4b3c-8602-b0542efa13c9 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:35.696681 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ff78b-b0dc-42fb-b657-1c88a96db437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:35.697469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ff78b-b0dc-42fb-b657-1c88a96db437 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:35.697749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ff78b-b0dc-42fb-b657-1c88a96db437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:35.698022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ff78b-b0dc-42fb-b657-1c88a96db437 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:35.698735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ff78b-b0dc-42fb-b657-1c88a96db437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:35.700342 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ff78b-b0dc-42fb-b657-1c88a96db437 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:35.710443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 889/1762] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:35.714382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f71f0-8b71-4a1d-8df8-196d1dffba96 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:35.725769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f71f0-8b71-4a1d-8df8-196d1dffba96 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:35.730550 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8f935-f6ab-4923-98eb-197756b2ca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:35.732038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8f935-f6ab-4923-98eb-197756b2ca69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:35.732350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8f935-f6ab-4923-98eb-197756b2ca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:35.732571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8f935-f6ab-4923-98eb-197756b2ca69 admin admin] PATH_INFO: `/v3/projects/25939ca7165e485484b879205576e8d4/users/e3ea636f010845b491d5b06ec67411bd/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:35.734535 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8f935-f6ab-4923-98eb-197756b2ca69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25939ca7165e485484b879205576e8d4, user_id=e3ea636f010845b491d5b06ec67411bd, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:35.737211 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8f935-f6ab-4923-98eb-197756b2ca69 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:35.747481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 874/1763] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:35 2022] PUT /identity/v3/projects/25939ca7165e485484b879205576e8d4/users/e3ea636f010845b491d5b06ec67411bd/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:35.759145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf943cf9-de4c-44f1-9c84-22ced3c73750 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:35.759434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf943cf9-de4c-44f1-9c84-22ced3c73750 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:35.759708 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf943cf9-de4c-44f1-9c84-22ced3c73750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:35.789851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-cf943cf9-de4c-44f1-9c84-22ced3c73750 None None] MFA Rules not processed for user `e3ea636f010845b491d5b06ec67411bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:35.791109 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cf943cf9-de4c-44f1-9c84-22ced3c73750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:35.859556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 890/1764] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:35.871552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8f935-f6ab-4923-98eb-197756b2ca69 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:35.873364 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-76e8f935-f6ab-4923-98eb-197756b2ca69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:35.933414 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8f935-f6ab-4923-98eb-197756b2ca69 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:35.937294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477920f-6ea3-4617-bcf6-ed5add70740f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:35.938130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477920f-6ea3-4617-bcf6-ed5add70740f service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:35.938598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477920f-6ea3-4617-bcf6-ed5add70740f service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:35.939073 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477920f-6ea3-4617-bcf6-ed5add70740f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:35.950586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477920f-6ea3-4617-bcf6-ed5add70740f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:35.952068 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477920f-6ea3-4617-bcf6-ed5add70740f service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:35.962008 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 875/1765] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:36.043242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf943cf9-de4c-44f1-9c84-22ced3c73750 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:36.118766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf943cf9-de4c-44f1-9c84-22ced3c73750 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:36.118766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:36.118766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:36.118766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:36.119350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] PATH_INFO: `/v3/users/b34f50dc30c146aebb86ae05a365fb8e` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:36.119350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34f50dc30c146aebb86ae05a365fb8e)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:36.119564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: WARNING py.warnings [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:38:36.119564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: warnings.warn(msg) Feb 28 10:38:36.119564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: Feb 28 10:38:36.120756 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:36.185204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34f50dc30c146aebb86ae05a365fb8e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.185951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34f50dc30c146aebb86ae05a365fb8e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.186614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34f50dc30c146aebb86ae05a365fb8e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.204749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34f50dc30c146aebb86ae05a365fb8e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.211714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34f50dc30c146aebb86ae05a365fb8e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.227166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 891/1766] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:36 2022] DELETE /identity/v3/users/b34f50dc30c146aebb86ae05a365fb8e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:36.231730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9285-e704-44c4-b0a8-3cbbbd86127b None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:36.232208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9285-e704-44c4-b0a8-3cbbbd86127b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:36.232317 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9285-e704-44c4-b0a8-3cbbbd86127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:36.249263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-7f8e9285-e704-44c4-b0a8-3cbbbd86127b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:36.250432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7f8e9285-e704-44c4-b0a8-3cbbbd86127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:36.313005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 876/1767] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:36.322513 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:36.323934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:36.378128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359e51e-477b-48e4-9b1f-c6c22bbcbf09 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:36.381635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65362-fd68-4884-9831-184dcd16c921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:36.382536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65362-fd68-4884-9831-184dcd16c921 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:36.382819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65362-fd68-4884-9831-184dcd16c921 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:36.383124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65362-fd68-4884-9831-184dcd16c921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:36.392393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c65362-fd68-4884-9831-184dcd16c921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:36.393803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c65362-fd68-4884-9831-184dcd16c921 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:36.402873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 892/1768] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:36.741991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e9285-e704-44c4-b0a8-3cbbbd86127b None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:36.743420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7f8e9285-e704-44c4-b0a8-3cbbbd86127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:36.755554 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e9285-e704-44c4-b0a8-3cbbbd86127b None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:36.760307 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:36.761141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:36.761416 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:36.761692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] PATH_INFO: `/v3/projects/7690f0be654d469c9bbdf16d823ac6ad` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:36.762888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7690f0be654d469c9bbdf16d823ac6ad)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:36.764792 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:36.813112 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7690f0be654d469c9bbdf16d823ac6ad', 'request_id': 'req-0e7b4704-96d1-4f30-b8b1-5b84fb282408'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.818498 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7690f0be654d469c9bbdf16d823ac6ad', 'request_id': 'req-0e7b4704-96d1-4f30-b8b1-5b84fb282408'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.827960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7690f0be654d469c9bbdf16d823ac6ad', 'request_id': 'req-0e7b4704-96d1-4f30-b8b1-5b84fb282408'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.846197 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] The token cache is being invalidate because project 7690f0be654d469c9bbdf16d823ac6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:36.846488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.847153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.848687 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 877/1769] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:36 2022] DELETE /identity/v3/projects/7690f0be654d469c9bbdf16d823ac6ad => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:36.852593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65362-fd68-4884-9831-184dcd16c921 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:36.862624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65362-fd68-4884-9831-184dcd16c921 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:36.917619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900aa0e-9d22-4843-a56c-bcf91329d183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:36.919028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900aa0e-9d22-4843-a56c-bcf91329d183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:36.919309 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900aa0e-9d22-4843-a56c-bcf91329d183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:36.919583 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900aa0e-9d22-4843-a56c-bcf91329d183 admin admin] PATH_INFO: `/v3/users/e3ea636f010845b491d5b06ec67411bd` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:36.920762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900aa0e-9d22-4843-a56c-bcf91329d183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ea636f010845b491d5b06ec67411bd)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:36.922670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900aa0e-9d22-4843-a56c-bcf91329d183 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:36.964956 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1900aa0e-9d22-4843-a56c-bcf91329d183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ea636f010845b491d5b06ec67411bd'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.965593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1900aa0e-9d22-4843-a56c-bcf91329d183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ea636f010845b491d5b06ec67411bd'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.966197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1900aa0e-9d22-4843-a56c-bcf91329d183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ea636f010845b491d5b06ec67411bd'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.978818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1900aa0e-9d22-4843-a56c-bcf91329d183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ea636f010845b491d5b06ec67411bd'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.986538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1900aa0e-9d22-4843-a56c-bcf91329d183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ea636f010845b491d5b06ec67411bd'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:36.999201 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 893/1770] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:36 2022] DELETE /identity/v3/users/e3ea636f010845b491d5b06ec67411bd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:37.408363 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:37.410073 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:37.424934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b4704-96d1-4f30-b8b1-5b84fb282408 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:37.506119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:37.507528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:37.507997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:37.508381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] PATH_INFO: `/v3/projects/25939ca7165e485484b879205576e8d4` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:37.513130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] RBAC: Authorizing `identity:delete_project(project_id=25939ca7165e485484b879205576e8d4)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:37.515242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:37.566168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25939ca7165e485484b879205576e8d4', 'request_id': 'req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:37.571682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25939ca7165e485484b879205576e8d4', 'request_id': 'req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:37.578851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25939ca7165e485484b879205576e8d4', 'request_id': 'req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:37.591181 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] The token cache is being invalidate because project 25939ca7165e485484b879205576e8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:37.591463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:37.592081 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-001fa6c0-f0a0-4b3b-b3ec-a7a9af96551b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:37.593716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 878/1771] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:37 2022] DELETE /identity/v3/projects/25939ca7165e485484b879205576e8d4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:37.598886 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8209cc2-4d83-4456-b846-36451730817a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:37.599371 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8209cc2-4d83-4456-b846-36451730817a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:37.599478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8209cc2-4d83-4456-b846-36451730817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:37.617124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-d8209cc2-4d83-4456-b846-36451730817a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:37.618343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d8209cc2-4d83-4456-b846-36451730817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:37.677341 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 894/1772] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:37.684997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be38a34-a52e-46f4-91f3-d88ac4c5accf None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:37.685295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be38a34-a52e-46f4-91f3-d88ac4c5accf None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:37.685560 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be38a34-a52e-46f4-91f3-d88ac4c5accf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:37.703932 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-9be38a34-a52e-46f4-91f3-d88ac4c5accf None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:37.705162 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9be38a34-a52e-46f4-91f3-d88ac4c5accf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:37.714334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 879/1773] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:37.723626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8209cc2-4d83-4456-b846-36451730817a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:37.745149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8209cc2-4d83-4456-b846-36451730817a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:37.749701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e32aac-cd20-49f5-af01-4295e58d368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:37.750516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32aac-cd20-49f5-af01-4295e58d368f admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:37.750644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32aac-cd20-49f5-af01-4295e58d368f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:37.750891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32aac-cd20-49f5-af01-4295e58d368f admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:37.751740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e32aac-cd20-49f5-af01-4295e58d368f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:38:37.752048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e32aac-cd20-49f5-af01-4295e58d368f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:37.753640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e32aac-cd20-49f5-af01-4295e58d368f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:37.766197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 895/1774] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:38:37.770578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be38a34-a52e-46f4-91f3-d88ac4c5accf None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:37.780460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be38a34-a52e-46f4-91f3-d88ac4c5accf None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:37.785359 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75eed9-eb16-4772-8b17-8ebca3354058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:37.786083 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75eed9-eb16-4772-8b17-8ebca3354058 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:37.786459 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75eed9-eb16-4772-8b17-8ebca3354058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:37.786802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75eed9-eb16-4772-8b17-8ebca3354058 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:37.787613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75eed9-eb16-4772-8b17-8ebca3354058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:37.789582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75eed9-eb16-4772-8b17-8ebca3354058 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:37.818703 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 880/1775] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:37 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:38:37.819953 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e32aac-cd20-49f5-af01-4295e58d368f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:37.830469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e32aac-cd20-49f5-af01-4295e58d368f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:37.902864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9b662-7b9d-4ecb-8dd2-08ec4b14bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:37.903611 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b662-7b9d-4ecb-8dd2-08ec4b14bfbf admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:37.903912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b662-7b9d-4ecb-8dd2-08ec4b14bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:37.904181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b662-7b9d-4ecb-8dd2-08ec4b14bfbf admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:37.904873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9b662-7b9d-4ecb-8dd2-08ec4b14bfbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:37.906800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9b662-7b9d-4ecb-8dd2-08ec4b14bfbf admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:37.931288 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 896/1776] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:37 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:37.936140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75eed9-eb16-4772-8b17-8ebca3354058 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:37.946521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75eed9-eb16-4772-8b17-8ebca3354058 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:37.951971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15effb08-f3f5-4589-9573-b61fd69516f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:37.952650 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15effb08-f3f5-4589-9573-b61fd69516f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:37.952929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15effb08-f3f5-4589-9573-b61fd69516f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:37.953205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15effb08-f3f5-4589-9573-b61fd69516f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:37.953933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15effb08-f3f5-4589-9573-b61fd69516f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:37.955866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15effb08-f3f5-4589-9573-b61fd69516f3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:37.973623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 881/1777] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:38:37.977945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9b662-7b9d-4ecb-8dd2-08ec4b14bfbf admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:37.988775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9b662-7b9d-4ecb-8dd2-08ec4b14bfbf admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:37.993818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d395410-84bd-4373-a56c-a11bef43cd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:37.994477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d395410-84bd-4373-a56c-a11bef43cd68 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:37.994761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d395410-84bd-4373-a56c-a11bef43cd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:37.995260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d395410-84bd-4373-a56c-a11bef43cd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:37.999537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d395410-84bd-4373-a56c-a11bef43cd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.001597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d395410-84bd-4373-a56c-a11bef43cd68 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.014955 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 897/1778] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:38.018877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15effb08-f3f5-4589-9573-b61fd69516f3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.031976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15effb08-f3f5-4589-9573-b61fd69516f3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:38.039459 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12785a75-36b4-475c-994c-bee3244719c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:38.040555 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12785a75-36b4-475c-994c-bee3244719c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.040786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12785a75-36b4-475c-994c-bee3244719c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.041105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12785a75-36b4-475c-994c-bee3244719c5 admin admin] PATH_INFO: `/v3/projects/5123bcc0858a43b2a29daa616f695f8c/users/897cfe27a67d4b5d8083e48117c7807a/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.065586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12785a75-36b4-475c-994c-bee3244719c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5123bcc0858a43b2a29daa616f695f8c, user_id=897cfe27a67d4b5d8083e48117c7807a, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.068574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12785a75-36b4-475c-994c-bee3244719c5 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.097663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 882/1779] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:38 2022] PUT /identity/v3/projects/5123bcc0858a43b2a29daa616f695f8c/users/897cfe27a67d4b5d8083e48117c7807a/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:38.100545 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09225c9-a227-4f2b-979d-99a27b25de45 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.101264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09225c9-a227-4f2b-979d-99a27b25de45 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.101658 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09225c9-a227-4f2b-979d-99a27b25de45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.131653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-d09225c9-a227-4f2b-979d-99a27b25de45 None None] MFA Rules not processed for user `897cfe27a67d4b5d8083e48117c7807a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:38.133536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d09225c9-a227-4f2b-979d-99a27b25de45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:38.196203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 898/1780] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:38.201146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12785a75-36b4-475c-994c-bee3244719c5 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.260368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12785a75-36b4-475c-994c-bee3244719c5 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:38.265462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59e325-b492-47a2-a224-ea51fbf2fc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:38.266118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e325-b492-47a2-a224-ea51fbf2fc05 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.266402 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e325-b492-47a2-a224-ea51fbf2fc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.266677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e325-b492-47a2-a224-ea51fbf2fc05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.267411 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59e325-b492-47a2-a224-ea51fbf2fc05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.269310 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59e325-b492-47a2-a224-ea51fbf2fc05 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.298537 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 883/1781] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:38 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:38.302497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09225c9-a227-4f2b-979d-99a27b25de45 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.313295 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09225c9-a227-4f2b-979d-99a27b25de45 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:38.368567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586c890-f481-47ec-8b0d-d6bd4444b535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:38.369128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586c890-f481-47ec-8b0d-d6bd4444b535 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.369411 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586c890-f481-47ec-8b0d-d6bd4444b535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.369685 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586c890-f481-47ec-8b0d-d6bd4444b535 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.370381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586c890-f481-47ec-8b0d-d6bd4444b535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.372399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586c890-f481-47ec-8b0d-d6bd4444b535 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.394948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 899/1782] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:38 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:38.396607 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59e325-b492-47a2-a224-ea51fbf2fc05 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.407101 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59e325-b492-47a2-a224-ea51fbf2fc05 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:38.411575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa01df-3166-4a3d-96e0-adbf037b8b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:38.412341 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa01df-3166-4a3d-96e0-adbf037b8b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.412621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa01df-3166-4a3d-96e0-adbf037b8b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.412888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa01df-3166-4a3d-96e0-adbf037b8b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.413602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa01df-3166-4a3d-96e0-adbf037b8b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.415257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa01df-3166-4a3d-96e0-adbf037b8b12 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.429813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 884/1783] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:38:38.431028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586c890-f481-47ec-8b0d-d6bd4444b535 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.441007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586c890-f481-47ec-8b0d-d6bd4444b535 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:38.445631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2caa1-8385-4d24-bb13-6ea198b8a5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:38.446281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2caa1-8385-4d24-bb13-6ea198b8a5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.446563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2caa1-8385-4d24-bb13-6ea198b8a5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.446839 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2caa1-8385-4d24-bb13-6ea198b8a5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.447590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2caa1-8385-4d24-bb13-6ea198b8a5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.449177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2caa1-8385-4d24-bb13-6ea198b8a5e3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.460151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 900/1784] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:38.465228 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa01df-3166-4a3d-96e0-adbf037b8b12 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.475082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa01df-3166-4a3d-96e0-adbf037b8b12 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:38.479655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f623d-fb7a-46a4-8a67-697fa3d42b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:38.480524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f623d-fb7a-46a4-8a67-697fa3d42b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.481340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f623d-fb7a-46a4-8a67-697fa3d42b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.481619 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f623d-fb7a-46a4-8a67-697fa3d42b42 admin admin] PATH_INFO: `/v3/projects/5064a561f216445bac711c5873e2de66/users/1b2e896bcecc43a8b0301de522c59628/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.496866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f623d-fb7a-46a4-8a67-697fa3d42b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5064a561f216445bac711c5873e2de66, user_id=1b2e896bcecc43a8b0301de522c59628, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.499739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f623d-fb7a-46a4-8a67-697fa3d42b42 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.516389 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 885/1785] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:38 2022] PUT /identity/v3/projects/5064a561f216445bac711c5873e2de66/users/1b2e896bcecc43a8b0301de522c59628/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:38.527699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c597-8675-4fa4-a166-c27c22acc39b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.528003 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c597-8675-4fa4-a166-c27c22acc39b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.528290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c597-8675-4fa4-a166-c27c22acc39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.564037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c792c597-8675-4fa4-a166-c27c22acc39b None None] MFA Rules not processed for user `1b2e896bcecc43a8b0301de522c59628`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:38.565234 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c792c597-8675-4fa4-a166-c27c22acc39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:38.632481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 901/1786] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:38.636923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f623d-fb7a-46a4-8a67-697fa3d42b42 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.696617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f623d-fb7a-46a4-8a67-697fa3d42b42 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:38.702198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbef1c2-e8eb-43cb-b6f1-24fb5f376552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:38.702852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbef1c2-e8eb-43cb-b6f1-24fb5f376552 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.703160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbef1c2-e8eb-43cb-b6f1-24fb5f376552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.703437 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbef1c2-e8eb-43cb-b6f1-24fb5f376552 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.704115 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbef1c2-e8eb-43cb-b6f1-24fb5f376552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.705996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbef1c2-e8eb-43cb-b6f1-24fb5f376552 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.729506 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 886/1787] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:38 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:38.733547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c597-8675-4fa4-a166-c27c22acc39b None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.743889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c597-8675-4fa4-a166-c27c22acc39b None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:38.798251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251ce29-2b1a-44eb-80fe-974d4aeb16b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:38.798834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251ce29-2b1a-44eb-80fe-974d4aeb16b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.799144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251ce29-2b1a-44eb-80fe-974d4aeb16b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.799421 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251ce29-2b1a-44eb-80fe-974d4aeb16b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.800096 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251ce29-2b1a-44eb-80fe-974d4aeb16b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.801998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251ce29-2b1a-44eb-80fe-974d4aeb16b9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.821079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 902/1788] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:38 2022] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:38.825627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbef1c2-e8eb-43cb-b6f1-24fb5f376552 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.835524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbef1c2-e8eb-43cb-b6f1-24fb5f376552 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:38.840047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fa5cb-ce41-4e33-a8b7-750e4b487cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:38.840687 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fa5cb-ce41-4e33-a8b7-750e4b487cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.840966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fa5cb-ce41-4e33-a8b7-750e4b487cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.841239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fa5cb-ce41-4e33-a8b7-750e4b487cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.841954 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fa5cb-ce41-4e33-a8b7-750e4b487cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.843571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fa5cb-ce41-4e33-a8b7-750e4b487cf0 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.853681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 887/1789] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:38.857590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251ce29-2b1a-44eb-80fe-974d4aeb16b9 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.867513 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251ce29-2b1a-44eb-80fe-974d4aeb16b9 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:38.872575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1a1cf-c61d-4463-b9f3-9a386fc0ceff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:38.873427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1a1cf-c61d-4463-b9f3-9a386fc0ceff admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.873742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1a1cf-c61d-4463-b9f3-9a386fc0ceff admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.874013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1a1cf-c61d-4463-b9f3-9a386fc0ceff admin admin] PATH_INFO: `/v3/projects/fa8da809417841dda6bfda18cb648662/users/7d08a4e0e3d840938e7c2c0fb303c95d/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.889268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1a1cf-c61d-4463-b9f3-9a386fc0ceff admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8da809417841dda6bfda18cb648662, user_id=7d08a4e0e3d840938e7c2c0fb303c95d, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.891934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1a1cf-c61d-4463-b9f3-9a386fc0ceff admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.903986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 903/1790] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:38 2022] PUT /identity/v3/projects/fa8da809417841dda6bfda18cb648662/users/7d08a4e0e3d840938e7c2c0fb303c95d/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:38.907785 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fa5cb-ce41-4e33-a8b7-750e4b487cf0 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.917545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fa5cb-ce41-4e33-a8b7-750e4b487cf0 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:38.970285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ba146-2ee9-4147-b556-a3c3fb733263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:38.970982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ba146-2ee9-4147-b556-a3c3fb733263 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:38.971263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ba146-2ee9-4147-b556-a3c3fb733263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:38.971536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ba146-2ee9-4147-b556-a3c3fb733263 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:38.972237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ba146-2ee9-4147-b556-a3c3fb733263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:38.973869 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ba146-2ee9-4147-b556-a3c3fb733263 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:38.983524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 888/1791] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:38.987601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1a1cf-c61d-4463-b9f3-9a386fc0ceff admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:38.998303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1a1cf-c61d-4463-b9f3-9a386fc0ceff admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:39.002819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea5f39-ed58-40eb-899e-d566639dca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:39.003704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5f39-ed58-40eb-899e-d566639dca64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:39.003984 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5f39-ed58-40eb-899e-d566639dca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:39.004262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5f39-ed58-40eb-899e-d566639dca64 admin admin] PATH_INFO: `/v3/projects/fa8da809417841dda6bfda18cb648662/users/7d08a4e0e3d840938e7c2c0fb303c95d/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:39.006210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea5f39-ed58-40eb-899e-d566639dca64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8da809417841dda6bfda18cb648662, user_id=7d08a4e0e3d840938e7c2c0fb303c95d, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:39.009117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea5f39-ed58-40eb-899e-d566639dca64 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:39.019023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 904/1792] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:38 2022] PUT /identity/v3/projects/fa8da809417841dda6bfda18cb648662/users/7d08a4e0e3d840938e7c2c0fb303c95d/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:39.029354 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2323-6d7e-4e2f-8edc-efe8745bdcac None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:39.029641 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2323-6d7e-4e2f-8edc-efe8745bdcac None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:39.029916 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2323-6d7e-4e2f-8edc-efe8745bdcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:39.057841 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-80db2323-6d7e-4e2f-8edc-efe8745bdcac None None] MFA Rules not processed for user `7d08a4e0e3d840938e7c2c0fb303c95d`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:39.059636 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-80db2323-6d7e-4e2f-8edc-efe8745bdcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:39.136505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 889/1793] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:39.147211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea5f39-ed58-40eb-899e-d566639dca64 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:39.148940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-85ea5f39-ed58-40eb-899e-d566639dca64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:39.212725 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea5f39-ed58-40eb-899e-d566639dca64 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:39.216413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232bde6-47fc-489a-b794-cd4274efddcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:39.217061 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232bde6-47fc-489a-b794-cd4274efddcf service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:39.217343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232bde6-47fc-489a-b794-cd4274efddcf service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:39.217618 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232bde6-47fc-489a-b794-cd4274efddcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:39.227055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232bde6-47fc-489a-b794-cd4274efddcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:39.228512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232bde6-47fc-489a-b794-cd4274efddcf service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:39.238595 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 905/1794] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:39.777415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2323-6d7e-4e2f-8edc-efe8745bdcac None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:39.788186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2323-6d7e-4e2f-8edc-efe8745bdcac None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:39.791731 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a4169-08d2-48aa-8258-3f2d146e1603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:39.792378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4169-08d2-48aa-8258-3f2d146e1603 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:39.792661 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4169-08d2-48aa-8258-3f2d146e1603 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:39.792945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4169-08d2-48aa-8258-3f2d146e1603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:39.849984 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a4169-08d2-48aa-8258-3f2d146e1603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:39.851472 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a4169-08d2-48aa-8258-3f2d146e1603 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:39.860469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 890/1795] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:45.585963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232bde6-47fc-489a-b794-cd4274efddcf service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:45.587448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-1232bde6-47fc-489a-b794-cd4274efddcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:45.649452 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232bde6-47fc-489a-b794-cd4274efddcf service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:45.653927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:45.654771 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:45.655078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:45.655348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] PATH_INFO: `/v3/users/12d8a8a178aa4a8a8412094b4ae9b34c` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:45.656505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d8a8a178aa4a8a8412094b4ae9b34c)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:45.658409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:45.701055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d8a8a178aa4a8a8412094b4ae9b34c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:45.701951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d8a8a178aa4a8a8412094b4ae9b34c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:45.702555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d8a8a178aa4a8a8412094b4ae9b34c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:45.714125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d8a8a178aa4a8a8412094b4ae9b34c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:45.723157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d8a8a178aa4a8a8412094b4ae9b34c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:45.737918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 906/1796] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:45 2022] DELETE /identity/v3/users/12d8a8a178aa4a8a8412094b4ae9b34c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:45.742414 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b112c-12eb-4026-af82-40a85c27657a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:45.742896 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b112c-12eb-4026-af82-40a85c27657a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:45.743110 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b112c-12eb-4026-af82-40a85c27657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:45.761705 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-8d9b112c-12eb-4026-af82-40a85c27657a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:45.763168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-8d9b112c-12eb-4026-af82-40a85c27657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:45.845221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 891/1797] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:45.854439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:45.856537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:45.945929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa13b-0f11-4e22-98e2-767b0499ac2d admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:45.953657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc683bb6-93e7-4f1d-a88a-4e89e56a8179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:45.953657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc683bb6-93e7-4f1d-a88a-4e89e56a8179 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:45.953657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc683bb6-93e7-4f1d-a88a-4e89e56a8179 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:45.953657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc683bb6-93e7-4f1d-a88a-4e89e56a8179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:45.963727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc683bb6-93e7-4f1d-a88a-4e89e56a8179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:45.965656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc683bb6-93e7-4f1d-a88a-4e89e56a8179 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:45.987428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 907/1798] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:46.260867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b112c-12eb-4026-af82-40a85c27657a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:46.262291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-8d9b112c-12eb-4026-af82-40a85c27657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:46.273872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b112c-12eb-4026-af82-40a85c27657a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:46.279459 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:46.280469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:46.280752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:46.281021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] PATH_INFO: `/v3/projects/7c51f8827e214ea395ef5f10f3d266f8` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:46.283132 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c51f8827e214ea395ef5f10f3d266f8)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:46.285111 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:46.330754 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c51f8827e214ea395ef5f10f3d266f8', 'request_id': 'req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:46.336548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c51f8827e214ea395ef5f10f3d266f8', 'request_id': 'req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:46.343628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c51f8827e214ea395ef5f10f3d266f8', 'request_id': 'req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:46.355409 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] The token cache is being invalidate because project 7c51f8827e214ea395ef5f10f3d266f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:46.355717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:46.356967 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:46.358480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 892/1799] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:46 2022] DELETE /identity/v3/projects/7c51f8827e214ea395ef5f10f3d266f8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:46.362411 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc683bb6-93e7-4f1d-a88a-4e89e56a8179 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:46.371796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc683bb6-93e7-4f1d-a88a-4e89e56a8179 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:46.425771 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44af9c-7d7b-4955-a75f-f280cd3606ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:46.426668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44af9c-7d7b-4955-a75f-f280cd3606ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:46.426971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44af9c-7d7b-4955-a75f-f280cd3606ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:46.427362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44af9c-7d7b-4955-a75f-f280cd3606ac admin admin] PATH_INFO: `/v3/users/be54e00a985e4a508e9cc0c989dc3f36` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:46.428560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44af9c-7d7b-4955-a75f-f280cd3606ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=be54e00a985e4a508e9cc0c989dc3f36)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:46.430489 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44af9c-7d7b-4955-a75f-f280cd3606ac admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:46.480077 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-de44af9c-7d7b-4955-a75f-f280cd3606ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be54e00a985e4a508e9cc0c989dc3f36'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:46.480723 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-de44af9c-7d7b-4955-a75f-f280cd3606ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be54e00a985e4a508e9cc0c989dc3f36'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:46.481318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-de44af9c-7d7b-4955-a75f-f280cd3606ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be54e00a985e4a508e9cc0c989dc3f36'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:46.492656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-de44af9c-7d7b-4955-a75f-f280cd3606ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be54e00a985e4a508e9cc0c989dc3f36'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:46.499552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-de44af9c-7d7b-4955-a75f-f280cd3606ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be54e00a985e4a508e9cc0c989dc3f36'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:46.511744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 908/1800] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:46 2022] DELETE /identity/v3/users/be54e00a985e4a508e9cc0c989dc3f36 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:46.925292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:46.926949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:46.941056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bb56c-1df8-4eca-bc69-b7b58fd6f115 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:47.006224 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:47.007377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:47.007733 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:47.008041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] PATH_INFO: `/v3/projects/33c194c82fb84c249c232bbac0d3040e` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:47.009721 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c194c82fb84c249c232bbac0d3040e)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:47.012659 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:47.069793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c194c82fb84c249c232bbac0d3040e', 'request_id': 'req-b48424ae-8764-482a-adb0-f66ce5212a6b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:47.078349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c194c82fb84c249c232bbac0d3040e', 'request_id': 'req-b48424ae-8764-482a-adb0-f66ce5212a6b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:47.086034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c194c82fb84c249c232bbac0d3040e', 'request_id': 'req-b48424ae-8764-482a-adb0-f66ce5212a6b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:47.103520 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] The token cache is being invalidate because project 33c194c82fb84c249c232bbac0d3040e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:47.103894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:47.104757 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b48424ae-8764-482a-adb0-f66ce5212a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:47.109942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 893/1801] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:46 2022] DELETE /identity/v3/projects/33c194c82fb84c249c232bbac0d3040e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:47.111625 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf54dc-d0e8-441a-b673-165add8434b3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:47.112099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf54dc-d0e8-441a-b673-165add8434b3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:47.112182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf54dc-d0e8-441a-b673-165add8434b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:47.144423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-a9cf54dc-d0e8-441a-b673-165add8434b3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:47.145658 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a9cf54dc-d0e8-441a-b673-165add8434b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:47.256447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 909/1802] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:47.265579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb7c5e-07fa-4128-a0a3-a16c45d2a476 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:47.265938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb7c5e-07fa-4128-a0a3-a16c45d2a476 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:47.266285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb7c5e-07fa-4128-a0a3-a16c45d2a476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:47.286079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-8fdb7c5e-07fa-4128-a0a3-a16c45d2a476 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:47.287427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-8fdb7c5e-07fa-4128-a0a3-a16c45d2a476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:47.296810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 894/1803] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:47.301085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf54dc-d0e8-441a-b673-165add8434b3 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:47.311237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf54dc-d0e8-441a-b673-165add8434b3 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:47.315862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d105aa3-fc13-48c9-847a-ff383928f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:47.316515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d105aa3-fc13-48c9-847a-ff383928f21b admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:47.316794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d105aa3-fc13-48c9-847a-ff383928f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:47.317064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d105aa3-fc13-48c9-847a-ff383928f21b admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:47.317779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d105aa3-fc13-48c9-847a-ff383928f21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:38:47.318083 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d105aa3-fc13-48c9-847a-ff383928f21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:47.319739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d105aa3-fc13-48c9-847a-ff383928f21b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:47.331374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 910/1804] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:38:47.335760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb7c5e-07fa-4128-a0a3-a16c45d2a476 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:47.344993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb7c5e-07fa-4128-a0a3-a16c45d2a476 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:47.349634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094b813-bcf7-431e-b263-03a3872c89a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:47.350341 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b813-bcf7-431e-b263-03a3872c89a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:47.350607 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b813-bcf7-431e-b263-03a3872c89a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:47.351112 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b813-bcf7-431e-b263-03a3872c89a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:47.351600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094b813-bcf7-431e-b263-03a3872c89a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:47.353511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094b813-bcf7-431e-b263-03a3872c89a4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:47.385639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 895/1805] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:47 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:47.386804 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d105aa3-fc13-48c9-847a-ff383928f21b admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:47.396708 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d105aa3-fc13-48c9-847a-ff383928f21b admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:47.462056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d86b82-05a1-4aff-b317-64d5549e9227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:47.462779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d86b82-05a1-4aff-b317-64d5549e9227 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:47.463085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d86b82-05a1-4aff-b317-64d5549e9227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:47.463354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d86b82-05a1-4aff-b317-64d5549e9227 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:47.464296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d86b82-05a1-4aff-b317-64d5549e9227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:47.466430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d86b82-05a1-4aff-b317-64d5549e9227 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:47.489623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 911/1806] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:47 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:47.493701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094b813-bcf7-431e-b263-03a3872c89a4 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:47.504548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094b813-bcf7-431e-b263-03a3872c89a4 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:47.510083 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382d676-485d-47e0-b2d2-0bb8eea88ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:47.510738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382d676-485d-47e0-b2d2-0bb8eea88ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:47.511042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382d676-485d-47e0-b2d2-0bb8eea88ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:47.511311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382d676-485d-47e0-b2d2-0bb8eea88ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:47.512048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382d676-485d-47e0-b2d2-0bb8eea88ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:47.513660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382d676-485d-47e0-b2d2-0bb8eea88ce3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:47.524109 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 896/1807] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:47.528852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d86b82-05a1-4aff-b317-64d5549e9227 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:47.538572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d86b82-05a1-4aff-b317-64d5549e9227 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:47.544076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1e230-5c84-4353-b261-6479a6fcd0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:47.544724 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1e230-5c84-4353-b261-6479a6fcd0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:47.545004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1e230-5c84-4353-b261-6479a6fcd0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:47.545278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1e230-5c84-4353-b261-6479a6fcd0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:47.545992 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1e230-5c84-4353-b261-6479a6fcd0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:47.547666 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1e230-5c84-4353-b261-6479a6fcd0d0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:47.557308 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 912/1808] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:47.561270 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382d676-485d-47e0-b2d2-0bb8eea88ce3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:47.571241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382d676-485d-47e0-b2d2-0bb8eea88ce3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:47.575761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c74bd-3acb-413c-a616-adbbe2681117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:47.576614 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c74bd-3acb-413c-a616-adbbe2681117 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:47.576885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c74bd-3acb-413c-a616-adbbe2681117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:47.577149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c74bd-3acb-413c-a616-adbbe2681117 admin admin] PATH_INFO: `/v3/projects/f881e1a1977f4441b63f2b0fba7791b5/users/696ca64116714456a8ae841b5ed76f84/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:47.591645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c74bd-3acb-413c-a616-adbbe2681117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f881e1a1977f4441b63f2b0fba7791b5, user_id=696ca64116714456a8ae841b5ed76f84, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:47.594290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c74bd-3acb-413c-a616-adbbe2681117 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:47.607487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 897/1809] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:47 2022] PUT /identity/v3/projects/f881e1a1977f4441b63f2b0fba7791b5/users/696ca64116714456a8ae841b5ed76f84/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:47.617246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4584-5470-4231-a44b-39eee406bb4f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:47.617517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4584-5470-4231-a44b-39eee406bb4f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:47.617789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4584-5470-4231-a44b-39eee406bb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:47.643445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c4fe4584-5470-4231-a44b-39eee406bb4f None None] MFA Rules not processed for user `696ca64116714456a8ae841b5ed76f84`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:47.644640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c4fe4584-5470-4231-a44b-39eee406bb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:47.707826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 913/1810] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:47.719025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c74bd-3acb-413c-a616-adbbe2681117 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:47.720792 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-bc6c74bd-3acb-413c-a616-adbbe2681117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:47.784058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c74bd-3acb-413c-a616-adbbe2681117 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:47.788517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a583f-50b2-4a01-ba56-3b137c15ec78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:47.789261 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a583f-50b2-4a01-ba56-3b137c15ec78 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:47.789486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a583f-50b2-4a01-ba56-3b137c15ec78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:47.789762 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a583f-50b2-4a01-ba56-3b137c15ec78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:47.799098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a583f-50b2-4a01-ba56-3b137c15ec78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:47.800542 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a583f-50b2-4a01-ba56-3b137c15ec78 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:47.809406 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 898/1811] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:48.251800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe4584-5470-4231-a44b-39eee406bb4f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:48.253372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c4fe4584-5470-4231-a44b-39eee406bb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:48.300136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b331a-9e50-4a83-98a4-42bebffa0440 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:48.300613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b331a-9e50-4a83-98a4-42bebffa0440 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:48.300689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b331a-9e50-4a83-98a4-42bebffa0440 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:48.302696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 899/1812] 10.222.0.44 () {54 vars in 921 bytes} [Mon Feb 28 10:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:38:48.311604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3ada-73d8-4d8b-9238-8c2e1f37f085 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:48.311802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3ada-73d8-4d8b-9238-8c2e1f37f085 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:48.312227 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3ada-73d8-4d8b-9238-8c2e1f37f085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:48.340745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-658c3ada-73d8-4d8b-9238-8c2e1f37f085 None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:48.343674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-658c3ada-73d8-4d8b-9238-8c2e1f37f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:48.345043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe4584-5470-4231-a44b-39eee406bb4f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:48.353806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ea14d-8f31-4b11-84c5-bd81d5ea1619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:48.354889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ea14d-8f31-4b11-84c5-bd81d5ea1619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:48.355202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ea14d-8f31-4b11-84c5-bd81d5ea1619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:48.355478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ea14d-8f31-4b11-84c5-bd81d5ea1619 admin admin] PATH_INFO: `/v3/users/fb95bbc7951a43e98317b13f123822dc` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:48.356728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ea14d-8f31-4b11-84c5-bd81d5ea1619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb95bbc7951a43e98317b13f123822dc)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:48.358790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ea14d-8f31-4b11-84c5-bd81d5ea1619 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:48.431267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-332ea14d-8f31-4b11-84c5-bd81d5ea1619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb95bbc7951a43e98317b13f123822dc'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:48.432106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-332ea14d-8f31-4b11-84c5-bd81d5ea1619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb95bbc7951a43e98317b13f123822dc'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:48.432822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-332ea14d-8f31-4b11-84c5-bd81d5ea1619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb95bbc7951a43e98317b13f123822dc'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:48.450778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-332ea14d-8f31-4b11-84c5-bd81d5ea1619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb95bbc7951a43e98317b13f123822dc'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:48.457466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 900/1813] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Feb 28 10:38:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:38:48.462172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-332ea14d-8f31-4b11-84c5-bd81d5ea1619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb95bbc7951a43e98317b13f123822dc'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:48.477957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c3ada-73d8-4d8b-9238-8c2e1f37f085 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:48.479533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-658c3ada-73d8-4d8b-9238-8c2e1f37f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:48.498077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c3ada-73d8-4d8b-9238-8c2e1f37f085 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:48.498663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 914/1814] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:48 2022] DELETE /identity/v3/users/fb95bbc7951a43e98317b13f123822dc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:48.505769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca2097-e73d-4eca-8f68-d32b1accf3a0 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:48.506263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca2097-e73d-4eca-8f68-d32b1accf3a0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:48.507060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca2097-e73d-4eca-8f68-d32b1accf3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:48.525945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-ffca2097-e73d-4eca-8f68-d32b1accf3a0 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:48.527955 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ffca2097-e73d-4eca-8f68-d32b1accf3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:48.582318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6e09a-ead0-471d-9269-0a77b482714d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:48.583060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6e09a-ead0-471d-9269-0a77b482714d service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:48.583343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6e09a-ead0-471d-9269-0a77b482714d service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:48.583630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6e09a-ead0-471d-9269-0a77b482714d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:48.593836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6e09a-ead0-471d-9269-0a77b482714d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:48.595471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6e09a-ead0-471d-9269-0a77b482714d service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:48.609125 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 901/1815] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:48.629405 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 915/1816] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:38:48.639127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6e09a-ead0-471d-9269-0a77b482714d service nova] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:48.640544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-91d6e09a-ead0-471d-9269-0a77b482714d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:48.705993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6e09a-ead0-471d-9269-0a77b482714d service nova] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:48.710521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14de1e2-7287-486b-b937-749a2d49572c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:48.711303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de1e2-7287-486b-b937-749a2d49572c service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:48.711693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de1e2-7287-486b-b937-749a2d49572c service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:48.712126 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de1e2-7287-486b-b937-749a2d49572c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:48.722452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14de1e2-7287-486b-b937-749a2d49572c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:48.724076 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14de1e2-7287-486b-b937-749a2d49572c service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:48.737140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 902/1817] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:49.079532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca2097-e73d-4eca-8f68-d32b1accf3a0 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:49.093671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ffca2097-e73d-4eca-8f68-d32b1accf3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:49.106989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca2097-e73d-4eca-8f68-d32b1accf3a0 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:49.122386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:49.123656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:49.124371 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:49.125005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] PATH_INFO: `/v3/projects/969d6d0b517143d792afd1f443bd70e8` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:49.129842 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969d6d0b517143d792afd1f443bd70e8)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:49.133427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:49.257476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969d6d0b517143d792afd1f443bd70e8', 'request_id': 'req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:49.267038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969d6d0b517143d792afd1f443bd70e8', 'request_id': 'req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:49.275481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14de1e2-7287-486b-b937-749a2d49572c service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:49.277080 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a14de1e2-7287-486b-b937-749a2d49572c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:49.284766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969d6d0b517143d792afd1f443bd70e8', 'request_id': 'req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:49.310403 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] The token cache is being invalidate because project 969d6d0b517143d792afd1f443bd70e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:49.310791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:49.312575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6f148079-8a0f-4f82-818c-a6e8f3a60ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:49.317359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 916/1818] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:49 2022] DELETE /identity/v3/projects/969d6d0b517143d792afd1f443bd70e8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:49.322718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d099-adc9-4f28-91ac-95a82143c847 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:49.323091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d099-adc9-4f28-91ac-95a82143c847 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:49.323436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d099-adc9-4f28-91ac-95a82143c847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:49.376176 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-9e23d099-adc9-4f28-91ac-95a82143c847 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:49.380050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-9e23d099-adc9-4f28-91ac-95a82143c847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:49.417760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14de1e2-7287-486b-b937-749a2d49572c service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:49.500323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 917/1819] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:49.511125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2b7f5-114b-4bbb-a672-757ee2089aca None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:49.511446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2b7f5-114b-4bbb-a672-757ee2089aca None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:49.514299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2b7f5-114b-4bbb-a672-757ee2089aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:49.551799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f316e-1a79-4597-99ea-23889a488667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:49.552584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f316e-1a79-4597-99ea-23889a488667 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:49.553212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f316e-1a79-4597-99ea-23889a488667 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:49.553497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f316e-1a79-4597-99ea-23889a488667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:49.555834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e32f316e-1a79-4597-99ea-23889a488667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:49.561049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-4ef2b7f5-114b-4bbb-a672-757ee2089aca None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:49.562690 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4ef2b7f5-114b-4bbb-a672-757ee2089aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:49.573245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 918/1820] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:49.577791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2b7f5-114b-4bbb-a672-757ee2089aca None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:49.592489 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2b7f5-114b-4bbb-a672-757ee2089aca None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:49.610239 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e86ca-5244-4cd4-8b31-e54498858ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:49.611634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e86ca-5244-4cd4-8b31-e54498858ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:49.612244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e86ca-5244-4cd4-8b31-e54498858ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:49.612796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e86ca-5244-4cd4-8b31-e54498858ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:49.613663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e86ca-5244-4cd4-8b31-e54498858ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:38:49.614121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e86ca-5244-4cd4-8b31-e54498858ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:49.615884 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e86ca-5244-4cd4-8b31-e54498858ef3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:49.634018 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 919/1821] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:38:49.639138 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e86ca-5244-4cd4-8b31-e54498858ef3 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:49.639594 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f316e-1a79-4597-99ea-23889a488667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:49.641037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f316e-1a79-4597-99ea-23889a488667 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:49.651646 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 903/1822] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:38:49.658149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e86ca-5244-4cd4-8b31-e54498858ef3 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:49.664284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587c820-2152-437f-acae-22e64b5522f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:49.664560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587c820-2152-437f-acae-22e64b5522f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:49.664848 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587c820-2152-437f-acae-22e64b5522f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:49.665181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587c820-2152-437f-acae-22e64b5522f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:49.665888 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587c820-2152-437f-acae-22e64b5522f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:49.668728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587c820-2152-437f-acae-22e64b5522f0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:49.702959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 920/1823] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:49 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:49.706284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f316e-1a79-4597-99ea-23889a488667 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:49.717430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f316e-1a79-4597-99ea-23889a488667 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:49.798545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e184185-b8d8-4c48-8883-91cbee88269d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:49.799486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184185-b8d8-4c48-8883-91cbee88269d admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:49.799836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184185-b8d8-4c48-8883-91cbee88269d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:49.800177 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184185-b8d8-4c48-8883-91cbee88269d admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:49.800946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184185-b8d8-4c48-8883-91cbee88269d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:49.803388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184185-b8d8-4c48-8883-91cbee88269d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:49.830710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 904/1824] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:49 2022] POST /identity/v3/users => generated 303 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:49.834570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587c820-2152-437f-acae-22e64b5522f0 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:49.845485 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587c820-2152-437f-acae-22e64b5522f0 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:49.851067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee495e6-6991-4563-9fb6-799a8dd2207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:49.851727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee495e6-6991-4563-9fb6-799a8dd2207e admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:49.852012 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee495e6-6991-4563-9fb6-799a8dd2207e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:49.852286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee495e6-6991-4563-9fb6-799a8dd2207e admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:49.853002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee495e6-6991-4563-9fb6-799a8dd2207e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:49.854698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee495e6-6991-4563-9fb6-799a8dd2207e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:49.865196 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 921/1825] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:49.870708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e184185-b8d8-4c48-8883-91cbee88269d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:49.880085 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e184185-b8d8-4c48-8883-91cbee88269d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:49.885248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7939b-30a5-42b9-9714-cfeafd8f575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:49.885916 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7939b-30a5-42b9-9714-cfeafd8f575e admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:49.886215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7939b-30a5-42b9-9714-cfeafd8f575e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:49.886465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7939b-30a5-42b9-9714-cfeafd8f575e admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:49.887401 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7939b-30a5-42b9-9714-cfeafd8f575e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:49.889022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7939b-30a5-42b9-9714-cfeafd8f575e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:49.899778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 905/1826] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:49.907100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee495e6-6991-4563-9fb6-799a8dd2207e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:49.916433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee495e6-6991-4563-9fb6-799a8dd2207e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:49.924414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b2ba-b9d9-4ff1-a0d6-df2e0c2a298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:49.925494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b2ba-b9d9-4ff1-a0d6-df2e0c2a298a admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:49.925867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b2ba-b9d9-4ff1-a0d6-df2e0c2a298a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:49.926213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b2ba-b9d9-4ff1-a0d6-df2e0c2a298a admin admin] PATH_INFO: `/v3/projects/67d7ad3e93414b87bb77baa842c26007/users/2fd3dbfdb28444ab94fb82d674bfc2aa/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:49.944140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0b2ba-b9d9-4ff1-a0d6-df2e0c2a298a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d7ad3e93414b87bb77baa842c26007, user_id=2fd3dbfdb28444ab94fb82d674bfc2aa, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:49.947012 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0b2ba-b9d9-4ff1-a0d6-df2e0c2a298a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:49.961828 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 922/1827] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:49 2022] PUT /identity/v3/projects/67d7ad3e93414b87bb77baa842c26007/users/2fd3dbfdb28444ab94fb82d674bfc2aa/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:49.973041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f148cc-ac9b-41ce-9b7e-75a22f997ec8 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:49.973309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f148cc-ac9b-41ce-9b7e-75a22f997ec8 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:49.973585 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f148cc-ac9b-41ce-9b7e-75a22f997ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:50.002669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-b6f148cc-ac9b-41ce-9b7e-75a22f997ec8 None None] MFA Rules not processed for user `2fd3dbfdb28444ab94fb82d674bfc2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:50.004247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b6f148cc-ac9b-41ce-9b7e-75a22f997ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:50.082025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 906/1828] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:50.087124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b2ba-b9d9-4ff1-a0d6-df2e0c2a298a admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:50.162569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b2ba-b9d9-4ff1-a0d6-df2e0c2a298a admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:50.170668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842c58a-da94-4b18-af67-06721c7bb5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:50.171616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842c58a-da94-4b18-af67-06721c7bb5ed admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:50.171982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842c58a-da94-4b18-af67-06721c7bb5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:50.172337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842c58a-da94-4b18-af67-06721c7bb5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:50.173161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842c58a-da94-4b18-af67-06721c7bb5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:50.176493 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842c58a-da94-4b18-af67-06721c7bb5ed admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:50.218698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 923/1829] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:50 2022] POST /identity/v3/projects => generated 405 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:50.224253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f148cc-ac9b-41ce-9b7e-75a22f997ec8 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:50.238188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f148cc-ac9b-41ce-9b7e-75a22f997ec8 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:50.302873 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142101a-ed87-48aa-b15b-ea9c5a5d45d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:50.303792 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142101a-ed87-48aa-b15b-ea9c5a5d45d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:50.304067 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142101a-ed87-48aa-b15b-ea9c5a5d45d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:50.304365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142101a-ed87-48aa-b15b-ea9c5a5d45d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:50.305216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142101a-ed87-48aa-b15b-ea9c5a5d45d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:50.307352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142101a-ed87-48aa-b15b-ea9c5a5d45d9 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:50.328164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 907/1830] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:50 2022] POST /identity/v3/users => generated 309 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:50.332244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842c58a-da94-4b18-af67-06721c7bb5ed admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:50.343272 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842c58a-da94-4b18-af67-06721c7bb5ed admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:50.348135 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65670add-1577-4917-8f07-f9ad051c0d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:50.348955 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670add-1577-4917-8f07-f9ad051c0d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:50.349263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670add-1577-4917-8f07-f9ad051c0d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:50.349692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670add-1577-4917-8f07-f9ad051c0d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:50.350413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65670add-1577-4917-8f07-f9ad051c0d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:50.352034 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65670add-1577-4917-8f07-f9ad051c0d5b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:50.362508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 924/1831] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:50.366639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142101a-ed87-48aa-b15b-ea9c5a5d45d9 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:50.376622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142101a-ed87-48aa-b15b-ea9c5a5d45d9 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:50.382172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16189b58-22c3-4231-a534-8d3e6324ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:50.383093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16189b58-22c3-4231-a534-8d3e6324ac83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:50.383375 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16189b58-22c3-4231-a534-8d3e6324ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:50.383644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16189b58-22c3-4231-a534-8d3e6324ac83 admin admin] PATH_INFO: `/v3/projects/4a6468ed521543bfb2c5448f4c4f7ce9/users/6c293b9972934881a484e675a6ad8268/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:50.399964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16189b58-22c3-4231-a534-8d3e6324ac83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a6468ed521543bfb2c5448f4c4f7ce9, user_id=6c293b9972934881a484e675a6ad8268, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:50.403208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16189b58-22c3-4231-a534-8d3e6324ac83 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:50.416806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 908/1832] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:50 2022] PUT /identity/v3/projects/4a6468ed521543bfb2c5448f4c4f7ce9/users/6c293b9972934881a484e675a6ad8268/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:50.420767 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65670add-1577-4917-8f07-f9ad051c0d5b admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:50.430483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65670add-1577-4917-8f07-f9ad051c0d5b admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:50.485198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bda47-e5f0-4111-86e5-346edd1a09f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:50.485900 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bda47-e5f0-4111-86e5-346edd1a09f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:50.486183 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bda47-e5f0-4111-86e5-346edd1a09f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:50.486455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bda47-e5f0-4111-86e5-346edd1a09f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:50.487235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bda47-e5f0-4111-86e5-346edd1a09f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:50.488824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bda47-e5f0-4111-86e5-346edd1a09f9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:50.498495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 925/1833] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:50.502741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16189b58-22c3-4231-a534-8d3e6324ac83 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:50.514361 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16189b58-22c3-4231-a534-8d3e6324ac83 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:50.518659 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f3440-f82c-4c7b-9901-77f0484237c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:50.519637 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f3440-f82c-4c7b-9901-77f0484237c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:50.519970 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f3440-f82c-4c7b-9901-77f0484237c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:50.520179 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f3440-f82c-4c7b-9901-77f0484237c7 admin admin] PATH_INFO: `/v3/projects/4a6468ed521543bfb2c5448f4c4f7ce9/users/6c293b9972934881a484e675a6ad8268/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:50.522299 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f3440-f82c-4c7b-9901-77f0484237c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a6468ed521543bfb2c5448f4c4f7ce9, user_id=6c293b9972934881a484e675a6ad8268, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:50.525086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f3440-f82c-4c7b-9901-77f0484237c7 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:50.546543 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 909/1834] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:50 2022] PUT /identity/v3/projects/4a6468ed521543bfb2c5448f4c4f7ce9/users/6c293b9972934881a484e675a6ad8268/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:50.548260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1e6ae-f2af-41cb-a024-e31d6b204a37 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:50.548551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1e6ae-f2af-41cb-a024-e31d6b204a37 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:50.549123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1e6ae-f2af-41cb-a024-e31d6b204a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:50.580211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-10e1e6ae-f2af-41cb-a024-e31d6b204a37 None None] MFA Rules not processed for user `6c293b9972934881a484e675a6ad8268`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:50.581517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-10e1e6ae-f2af-41cb-a024-e31d6b204a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:50.659308 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 926/1835] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:50.669863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f3440-f82c-4c7b-9901-77f0484237c7 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:50.671862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-258f3440-f82c-4c7b-9901-77f0484237c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:50.726146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f3440-f82c-4c7b-9901-77f0484237c7 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:50.733118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d4f0b-4c84-407d-9739-4bf86c9de9a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:50.733778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d4f0b-4c84-407d-9739-4bf86c9de9a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:50.734061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d4f0b-4c84-407d-9739-4bf86c9de9a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:50.734816 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d4f0b-4c84-407d-9739-4bf86c9de9a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:50.751664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d4f0b-4c84-407d-9739-4bf86c9de9a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:50.753091 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d4f0b-4c84-407d-9739-4bf86c9de9a2 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:50.763309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 910/1836] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:50 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:53.616037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1e6ae-f2af-41cb-a024-e31d6b204a37 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:53.676200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1e6ae-f2af-41cb-a024-e31d6b204a37 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:53.681856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:53.683396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:53.684171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:53.684442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] PATH_INFO: `/v3/users/2fd3dbfdb28444ab94fb82d674bfc2aa` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:53.685640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd3dbfdb28444ab94fb82d674bfc2aa)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:53.688314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:53.738567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd3dbfdb28444ab94fb82d674bfc2aa'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:53.739310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd3dbfdb28444ab94fb82d674bfc2aa'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:53.739955 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd3dbfdb28444ab94fb82d674bfc2aa'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:53.752005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd3dbfdb28444ab94fb82d674bfc2aa'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:53.761575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd3dbfdb28444ab94fb82d674bfc2aa'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:53.783580 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 927/1837] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:53 2022] DELETE /identity/v3/users/2fd3dbfdb28444ab94fb82d674bfc2aa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:53.788176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70480174-6e7d-4d8f-89c8-3d619d3d2112 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:53.788642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70480174-6e7d-4d8f-89c8-3d619d3d2112 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:53.788916 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70480174-6e7d-4d8f-89c8-3d619d3d2112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:53.810421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-70480174-6e7d-4d8f-89c8-3d619d3d2112 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:53.811968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-70480174-6e7d-4d8f-89c8-3d619d3d2112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:53.874611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 911/1838] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:38:53.884872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:53.886319 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:53.952809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4ba8a-4c34-4c54-b92c-19c20a3b9590 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:53.956759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c427f-b2e7-42c3-ab74-4426de2c9345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:53.957433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c427f-b2e7-42c3-ab74-4426de2c9345 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:53.957742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c427f-b2e7-42c3-ab74-4426de2c9345 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:53.957986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c427f-b2e7-42c3-ab74-4426de2c9345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:53.967572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c427f-b2e7-42c3-ab74-4426de2c9345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:53.969005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c427f-b2e7-42c3-ab74-4426de2c9345 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:53.978726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 928/1839] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:54.333940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70480174-6e7d-4d8f-89c8-3d619d3d2112 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:54.335425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-70480174-6e7d-4d8f-89c8-3d619d3d2112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:54.349704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70480174-6e7d-4d8f-89c8-3d619d3d2112 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:54.354227 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:54.356924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:54.356924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:54.356924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] PATH_INFO: `/v3/projects/67d7ad3e93414b87bb77baa842c26007` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:54.358453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d7ad3e93414b87bb77baa842c26007)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:54.360381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:54.416157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d7ad3e93414b87bb77baa842c26007', 'request_id': 'req-86ca7d50-3183-4010-a72d-ad1ee62942e3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:54.423303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d7ad3e93414b87bb77baa842c26007', 'request_id': 'req-86ca7d50-3183-4010-a72d-ad1ee62942e3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:54.428768 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d7ad3e93414b87bb77baa842c26007', 'request_id': 'req-86ca7d50-3183-4010-a72d-ad1ee62942e3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:54.441395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] The token cache is being invalidate because project 67d7ad3e93414b87bb77baa842c26007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:54.441778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:54.442415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:54.444088 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 912/1840] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:54 2022] DELETE /identity/v3/projects/67d7ad3e93414b87bb77baa842c26007 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:54.448084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c427f-b2e7-42c3-ab74-4426de2c9345 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:54.457932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c427f-b2e7-42c3-ab74-4426de2c9345 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:54.555780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:54.556827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:54.557155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:54.557494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] PATH_INFO: `/v3/users/6c293b9972934881a484e675a6ad8268` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:54.565310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c293b9972934881a484e675a6ad8268)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:54.567743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:54.673285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c293b9972934881a484e675a6ad8268'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:54.673837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c293b9972934881a484e675a6ad8268'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:54.674453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c293b9972934881a484e675a6ad8268'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:54.701309 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c293b9972934881a484e675a6ad8268'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:54.710958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c293b9972934881a484e675a6ad8268'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:54.727341 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 929/1841] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:54 2022] DELETE /identity/v3/users/6c293b9972934881a484e675a6ad8268 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:55.101689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:55.104395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:55.125917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca7d50-3183-4010-a72d-ad1ee62942e3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:55.203652 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:55.204693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.205064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.205341 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] PATH_INFO: `/v3/projects/4a6468ed521543bfb2c5448f4c4f7ce9` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.206647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a6468ed521543bfb2c5448f4c4f7ce9)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:55.208671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:55.221551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:55.222837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:55.236305 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f42ac-3224-4dca-8fb3-9aca72d52de1 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:55.242123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1374a9-b1eb-41d9-aecf-e63f42adbebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:55.243150 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1374a9-b1eb-41d9-aecf-e63f42adbebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.243433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1374a9-b1eb-41d9-aecf-e63f42adbebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.243750 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1374a9-b1eb-41d9-aecf-e63f42adbebf admin admin] PATH_INFO: `/v3/users/897cfe27a67d4b5d8083e48117c7807a` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.244975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1374a9-b1eb-41d9-aecf-e63f42adbebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=897cfe27a67d4b5d8083e48117c7807a)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:55.247257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1374a9-b1eb-41d9-aecf-e63f42adbebf admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:55.262801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a6468ed521543bfb2c5448f4c4f7ce9', 'request_id': 'req-588acd8c-7fb1-4566-b7fe-46d738102029'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.269035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a6468ed521543bfb2c5448f4c4f7ce9', 'request_id': 'req-588acd8c-7fb1-4566-b7fe-46d738102029'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.276216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a6468ed521543bfb2c5448f4c4f7ce9', 'request_id': 'req-588acd8c-7fb1-4566-b7fe-46d738102029'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.290344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] The token cache is being invalidate because project 4a6468ed521543bfb2c5448f4c4f7ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:55.290742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.291696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-588acd8c-7fb1-4566-b7fe-46d738102029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.294307 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 913/1842] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:55 2022] DELETE /identity/v3/projects/4a6468ed521543bfb2c5448f4c4f7ce9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:55.298951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eeb3d-57f9-49ef-9d1c-52063f28d96d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.299483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eeb3d-57f9-49ef-9d1c-52063f28d96d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.299861 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eeb3d-57f9-49ef-9d1c-52063f28d96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.300905 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ac1374a9-b1eb-41d9-aecf-e63f42adbebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897cfe27a67d4b5d8083e48117c7807a'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.301575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ac1374a9-b1eb-41d9-aecf-e63f42adbebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897cfe27a67d4b5d8083e48117c7807a'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.302169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ac1374a9-b1eb-41d9-aecf-e63f42adbebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897cfe27a67d4b5d8083e48117c7807a'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.314055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ac1374a9-b1eb-41d9-aecf-e63f42adbebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897cfe27a67d4b5d8083e48117c7807a'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.319557 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-140eeb3d-57f9-49ef-9d1c-52063f28d96d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:55.320845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-140eeb3d-57f9-49ef-9d1c-52063f28d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:55.324889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ac1374a9-b1eb-41d9-aecf-e63f42adbebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897cfe27a67d4b5d8083e48117c7807a'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.339876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 930/1843] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:55 2022] DELETE /identity/v3/users/897cfe27a67d4b5d8083e48117c7807a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:55.347435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c49f95-1efa-4f76-81b9-e95a3d763ff6 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.347727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c49f95-1efa-4f76-81b9-e95a3d763ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.348009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c49f95-1efa-4f76-81b9-e95a3d763ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.366809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-79c49f95-1efa-4f76-81b9-e95a3d763ff6 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:55.367961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-79c49f95-1efa-4f76-81b9-e95a3d763ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:55.389596 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 914/1844] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:55.397256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223e62e-f19c-494b-8ad1-e22eb51a725a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.397555 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223e62e-f19c-494b-8ad1-e22eb51a725a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.397896 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223e62e-f19c-494b-8ad1-e22eb51a725a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.418427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-7223e62e-f19c-494b-8ad1-e22eb51a725a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:55.419852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7223e62e-f19c-494b-8ad1-e22eb51a725a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:55.433822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 931/1845] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:55.442970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c49f95-1efa-4f76-81b9-e95a3d763ff6 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:55.444305 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-79c49f95-1efa-4f76-81b9-e95a3d763ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:55.484952 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 915/1846] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:55.490053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223e62e-f19c-494b-8ad1-e22eb51a725a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:55.499989 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223e62e-f19c-494b-8ad1-e22eb51a725a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:55.504468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e4046-6ed6-4796-b46d-a83c055de38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:55.505108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e4046-6ed6-4796-b46d-a83c055de38b admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.505379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e4046-6ed6-4796-b46d-a83c055de38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.505645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e4046-6ed6-4796-b46d-a83c055de38b admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.506344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e4046-6ed6-4796-b46d-a83c055de38b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:38:55.506641 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e4046-6ed6-4796-b46d-a83c055de38b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:55.508128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c49f95-1efa-4f76-81b9-e95a3d763ff6 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:55.508494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e4046-6ed6-4796-b46d-a83c055de38b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:55.513108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d588d-800c-4de7-95b6-a2da8b930ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:55.513863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d588d-800c-4de7-95b6-a2da8b930ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.514244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d588d-800c-4de7-95b6-a2da8b930ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.514635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d588d-800c-4de7-95b6-a2da8b930ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.522951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 916/1847] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:38:55.524775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d588d-800c-4de7-95b6-a2da8b930ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:55.526271 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d588d-800c-4de7-95b6-a2da8b930ab0 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:55.528505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e4046-6ed6-4796-b46d-a83c055de38b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:55.540191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 932/1848] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:38:55.541338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e4046-6ed6-4796-b46d-a83c055de38b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:55.546176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b81a3-ce78-4877-925d-3dedb7c62317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:55.546828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b81a3-ce78-4877-925d-3dedb7c62317 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.547149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b81a3-ce78-4877-925d-3dedb7c62317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.547429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b81a3-ce78-4877-925d-3dedb7c62317 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.548287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b81a3-ce78-4877-925d-3dedb7c62317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:55.550173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b81a3-ce78-4877-925d-3dedb7c62317 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:55.576797 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 917/1849] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:55 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:55.581090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d588d-800c-4de7-95b6-a2da8b930ab0 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:55.591186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d588d-800c-4de7-95b6-a2da8b930ab0 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:55.651869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f00a-b996-4383-8a20-ed90650d93a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:55.653108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f00a-b996-4383-8a20-ed90650d93a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.653384 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f00a-b996-4383-8a20-ed90650d93a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.653661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f00a-b996-4383-8a20-ed90650d93a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.654835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0f00a-b996-4383-8a20-ed90650d93a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:55.656868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0f00a-b996-4383-8a20-ed90650d93a0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:55.700030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 933/1850] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:55 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:55.704647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b81a3-ce78-4877-925d-3dedb7c62317 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:55.717929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b81a3-ce78-4877-925d-3dedb7c62317 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:55.723332 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89f355-edb6-4f53-9b25-7ee1f0c04453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:55.724983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f355-edb6-4f53-9b25-7ee1f0c04453 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.725480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f355-edb6-4f53-9b25-7ee1f0c04453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.725850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f355-edb6-4f53-9b25-7ee1f0c04453 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.726943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89f355-edb6-4f53-9b25-7ee1f0c04453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:55.728398 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89f355-edb6-4f53-9b25-7ee1f0c04453 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:55.740877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 918/1851] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:55.744828 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f00a-b996-4383-8a20-ed90650d93a0 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:55.755803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f00a-b996-4383-8a20-ed90650d93a0 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:55.769536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295b21f-7f76-452d-aeb3-acf87bd3949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:55.770211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295b21f-7f76-452d-aeb3-acf87bd3949a admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.770490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295b21f-7f76-452d-aeb3-acf87bd3949a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.770792 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295b21f-7f76-452d-aeb3-acf87bd3949a admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.771555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295b21f-7f76-452d-aeb3-acf87bd3949a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:55.773140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295b21f-7f76-452d-aeb3-acf87bd3949a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:55.784464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 934/1852] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:55.788570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89f355-edb6-4f53-9b25-7ee1f0c04453 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:55.801081 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89f355-edb6-4f53-9b25-7ee1f0c04453 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:55.809647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca5016-3034-4b8f-b6c9-ee9ccfe14758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:55.811190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca5016-3034-4b8f-b6c9-ee9ccfe14758 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.811703 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca5016-3034-4b8f-b6c9-ee9ccfe14758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.812124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca5016-3034-4b8f-b6c9-ee9ccfe14758 admin admin] PATH_INFO: `/v3/projects/e31d3dbe12a04b9e90ff29f95c180f60/users/8be4839b150e45b4b693b19abd341099/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.820259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295b21f-7f76-452d-aeb3-acf87bd3949a admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:55.822793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0295b21f-7f76-452d-aeb3-acf87bd3949a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:55.842187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295b21f-7f76-452d-aeb3-acf87bd3949a admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:55.843565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca5016-3034-4b8f-b6c9-ee9ccfe14758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31d3dbe12a04b9e90ff29f95c180f60, user_id=8be4839b150e45b4b693b19abd341099, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:55.846312 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca5016-3034-4b8f-b6c9-ee9ccfe14758 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:55.849302 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:55.850225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.850494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.850782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] PATH_INFO: `/v3/projects/5123bcc0858a43b2a29daa616f695f8c` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.852689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5123bcc0858a43b2a29daa616f695f8c)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:55.855045 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:55.870612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 919/1853] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:55 2022] PUT /identity/v3/projects/e31d3dbe12a04b9e90ff29f95c180f60/users/8be4839b150e45b4b693b19abd341099/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:55.880676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9f83d-fae9-4c24-90c8-4ada41c6ce32 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:55.881009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9f83d-fae9-4c24-90c8-4ada41c6ce32 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:55.881428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9f83d-fae9-4c24-90c8-4ada41c6ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:55.911005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5123bcc0858a43b2a29daa616f695f8c', 'request_id': 'req-159e4314-dd4d-4ec5-a9e1-98481bd8e176'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.916172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5123bcc0858a43b2a29daa616f695f8c', 'request_id': 'req-159e4314-dd4d-4ec5-a9e1-98481bd8e176'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.918251 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-49d9f83d-fae9-4c24-90c8-4ada41c6ce32 None None] MFA Rules not processed for user `8be4839b150e45b4b693b19abd341099`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:55.919585 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-49d9f83d-fae9-4c24-90c8-4ada41c6ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:55.923354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5123bcc0858a43b2a29daa616f695f8c', 'request_id': 'req-159e4314-dd4d-4ec5-a9e1-98481bd8e176'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.938990 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] The token cache is being invalidate because project 5123bcc0858a43b2a29daa616f695f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:55.939282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.939931 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:55.941567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 935/1854] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:55 2022] DELETE /identity/v3/projects/5123bcc0858a43b2a29daa616f695f8c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:55.945512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:55.946949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:55.993434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 920/1855] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:55.998768 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9f83d-fae9-4c24-90c8-4ada41c6ce32 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.000108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-49d9f83d-fae9-4c24-90c8-4ada41c6ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:56.020562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e4314-dd4d-4ec5-a9e1-98481bd8e176 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.026500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.028025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.028315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.028592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] PATH_INFO: `/v3/users/1b2e896bcecc43a8b0301de522c59628` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.029845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2e896bcecc43a8b0301de522c59628)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.032288 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.077363 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9f83d-fae9-4c24-90c8-4ada41c6ce32 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.090322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2e896bcecc43a8b0301de522c59628'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.091895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2e896bcecc43a8b0301de522c59628'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.092490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2e896bcecc43a8b0301de522c59628'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.095593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097cefb-e5b8-4d28-83f3-f99c6ed38de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.097152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097cefb-e5b8-4d28-83f3-f99c6ed38de0 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.097152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097cefb-e5b8-4d28-83f3-f99c6ed38de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.097152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097cefb-e5b8-4d28-83f3-f99c6ed38de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.097795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097cefb-e5b8-4d28-83f3-f99c6ed38de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.100073 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097cefb-e5b8-4d28-83f3-f99c6ed38de0 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.105902 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2e896bcecc43a8b0301de522c59628'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.115226 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2e896bcecc43a8b0301de522c59628'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.128018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 921/1856] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:55 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:56.130979 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 936/1857] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:55 2022] DELETE /identity/v3/users/1b2e896bcecc43a8b0301de522c59628 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:56.136097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097cefb-e5b8-4d28-83f3-f99c6ed38de0 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.138715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e097cefb-e5b8-4d28-83f3-f99c6ed38de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:56.218004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097cefb-e5b8-4d28-83f3-f99c6ed38de0 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.275143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45632989-bf62-4ab5-900e-dd82c3ccd14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.275813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45632989-bf62-4ab5-900e-dd82c3ccd14b admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.276089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45632989-bf62-4ab5-900e-dd82c3ccd14b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.276365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45632989-bf62-4ab5-900e-dd82c3ccd14b admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.277040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45632989-bf62-4ab5-900e-dd82c3ccd14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.278991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45632989-bf62-4ab5-900e-dd82c3ccd14b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.299284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 922/1858] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:56 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:56.303284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.314968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d045c-86ed-4253-bf11-a0661406da14 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.320331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dba81-700c-4ee1-8754-dab9196b11d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.321242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dba81-700c-4ee1-8754-dab9196b11d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.321590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dba81-700c-4ee1-8754-dab9196b11d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.321966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dba81-700c-4ee1-8754-dab9196b11d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.322821 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dba81-700c-4ee1-8754-dab9196b11d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.324529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dba81-700c-4ee1-8754-dab9196b11d9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.334639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 937/1859] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:38:56.338653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45632989-bf62-4ab5-900e-dd82c3ccd14b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.348535 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45632989-bf62-4ab5-900e-dd82c3ccd14b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.354077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d1f3d-fd55-42d4-ab6a-8bdca2eedb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.354971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d1f3d-fd55-42d4-ab6a-8bdca2eedb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.356262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d1f3d-fd55-42d4-ab6a-8bdca2eedb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.356635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d1f3d-fd55-42d4-ab6a-8bdca2eedb1d admin admin] PATH_INFO: `/v3/projects/e4722c61c162418fa5265041df7a28f2/users/0a2ad0f3122a4565b13c5f5d1310c6a8/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.371941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d1f3d-fd55-42d4-ab6a-8bdca2eedb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4722c61c162418fa5265041df7a28f2, user_id=0a2ad0f3122a4565b13c5f5d1310c6a8, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.374580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d1f3d-fd55-42d4-ab6a-8bdca2eedb1d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.388280 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 923/1860] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:56 2022] PUT /identity/v3/projects/e4722c61c162418fa5265041df7a28f2/users/0a2ad0f3122a4565b13c5f5d1310c6a8/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:56.392053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dba81-700c-4ee1-8754-dab9196b11d9 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.402526 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dba81-700c-4ee1-8754-dab9196b11d9 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.448416 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d1f3d-fd55-42d4-ab6a-8bdca2eedb1d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.450447 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-194d1f3d-fd55-42d4-ab6a-8bdca2eedb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:56.461600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc68d9-e42f-44a1-85ab-9bfabb0a6a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.462271 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc68d9-e42f-44a1-85ab-9bfabb0a6a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.462552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc68d9-e42f-44a1-85ab-9bfabb0a6a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.462826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc68d9-e42f-44a1-85ab-9bfabb0a6a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.463584 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc68d9-e42f-44a1-85ab-9bfabb0a6a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.465204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc68d9-e42f-44a1-85ab-9bfabb0a6a1f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.475823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 938/1861] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:38:56.480387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc68d9-e42f-44a1-85ab-9bfabb0a6a1f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.492141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc68d9-e42f-44a1-85ab-9bfabb0a6a1f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.497491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b79ac3-0e13-433a-b93b-8656aa2d02b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.498352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b79ac3-0e13-433a-b93b-8656aa2d02b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.498638 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b79ac3-0e13-433a-b93b-8656aa2d02b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.498928 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b79ac3-0e13-433a-b93b-8656aa2d02b8 admin admin] PATH_INFO: `/v3/projects/e4722c61c162418fa5265041df7a28f2/users/0a2ad0f3122a4565b13c5f5d1310c6a8/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.500934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b79ac3-0e13-433a-b93b-8656aa2d02b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4722c61c162418fa5265041df7a28f2, user_id=0a2ad0f3122a4565b13c5f5d1310c6a8, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.503778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b79ac3-0e13-433a-b93b-8656aa2d02b8 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.514465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 939/1862] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:56 2022] PUT /identity/v3/projects/e4722c61c162418fa5265041df7a28f2/users/0a2ad0f3122a4565b13c5f5d1310c6a8/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:56.525314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fbd87-7699-4cb3-9094-9c4ad1d6fbbf None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.525609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fbd87-7699-4cb3-9094-9c4ad1d6fbbf None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.525893 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fbd87-7699-4cb3-9094-9c4ad1d6fbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.530142 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d1f3d-fd55-42d4-ab6a-8bdca2eedb1d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.552431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-142fbd87-7699-4cb3-9094-9c4ad1d6fbbf None None] MFA Rules not processed for user `0a2ad0f3122a4565b13c5f5d1310c6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:56.553641 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-142fbd87-7699-4cb3-9094-9c4ad1d6fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:56.586571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.587480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.587757 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.588030 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] PATH_INFO: `/v3/projects/5064a561f216445bac711c5873e2de66` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.589257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5064a561f216445bac711c5873e2de66)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.591806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.624900 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 940/1863] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:38:56.635936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fbd87-7699-4cb3-9094-9c4ad1d6fbbf None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.637283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-142fbd87-7699-4cb3-9094-9c4ad1d6fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:56.638264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5064a561f216445bac711c5873e2de66', 'request_id': 'req-526a600b-1af8-45bf-9a98-6011a742998f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.643745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5064a561f216445bac711c5873e2de66', 'request_id': 'req-526a600b-1af8-45bf-9a98-6011a742998f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.649856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5064a561f216445bac711c5873e2de66', 'request_id': 'req-526a600b-1af8-45bf-9a98-6011a742998f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.663194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] The token cache is being invalidate because project 5064a561f216445bac711c5873e2de66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:56.663477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.664108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.665740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 924/1864] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:56 2022] DELETE /identity/v3/projects/5064a561f216445bac711c5873e2de66 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:56.670074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.671503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:56.693044 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fbd87-7699-4cb3-9094-9c4ad1d6fbbf None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.732960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a600b-1af8-45bf-9a98-6011a742998f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.737559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0d243-d699-4a64-88d6-88bf84f6afe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.738414 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d243-d699-4a64-88d6-88bf84f6afe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.738693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d243-d699-4a64-88d6-88bf84f6afe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.738991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d243-d699-4a64-88d6-88bf84f6afe5 admin admin] PATH_INFO: `/v3/users/7d08a4e0e3d840938e7c2c0fb303c95d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.739811 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9b688-23db-4b7f-b0fc-c4c8cd38e21a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.740291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0d243-d699-4a64-88d6-88bf84f6afe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d08a4e0e3d840938e7c2c0fb303c95d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.740450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9b688-23db-4b7f-b0fc-c4c8cd38e21a service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.740730 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9b688-23db-4b7f-b0fc-c4c8cd38e21a service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.741001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9b688-23db-4b7f-b0fc-c4c8cd38e21a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.742071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0d243-d699-4a64-88d6-88bf84f6afe5 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.742773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f8f9b688-23db-4b7f-b0fc-c4c8cd38e21a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:56.786131 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5ca0d243-d699-4a64-88d6-88bf84f6afe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d08a4e0e3d840938e7c2c0fb303c95d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.786789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5ca0d243-d699-4a64-88d6-88bf84f6afe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d08a4e0e3d840938e7c2c0fb303c95d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.799464 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5ca0d243-d699-4a64-88d6-88bf84f6afe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d08a4e0e3d840938e7c2c0fb303c95d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.805897 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9b688-23db-4b7f-b0fc-c4c8cd38e21a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.807377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9b688-23db-4b7f-b0fc-c4c8cd38e21a service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.808448 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5ca0d243-d699-4a64-88d6-88bf84f6afe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d08a4e0e3d840938e7c2c0fb303c95d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.816031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5ca0d243-d699-4a64-88d6-88bf84f6afe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d08a4e0e3d840938e7c2c0fb303c95d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.816873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 941/1865] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:38:56.822031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 925/1866] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:56 2022] DELETE /identity/v3/users/7d08a4e0e3d840938e7c2c0fb303c95d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:57.222117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9b688-23db-4b7f-b0fc-c4c8cd38e21a service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.235192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9b688-23db-4b7f-b0fc-c4c8cd38e21a service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.311345 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.312222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.312555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.312830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] PATH_INFO: `/v3/projects/fa8da809417841dda6bfda18cb648662` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.314079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8da809417841dda6bfda18cb648662)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.316032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.366888 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8da809417841dda6bfda18cb648662', 'request_id': 'req-7c6c769a-6778-48e1-8765-d8e2ca1ae837'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:57.375565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8da809417841dda6bfda18cb648662', 'request_id': 'req-7c6c769a-6778-48e1-8765-d8e2ca1ae837'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:57.379476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8da809417841dda6bfda18cb648662', 'request_id': 'req-7c6c769a-6778-48e1-8765-d8e2ca1ae837'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:57.394639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] The token cache is being invalidate because project fa8da809417841dda6bfda18cb648662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:57.394982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:57.395777 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-7c6c769a-6778-48e1-8765-d8e2ca1ae837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:57.397645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 942/1867] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:57 2022] DELETE /identity/v3/projects/fa8da809417841dda6bfda18cb648662 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:57.404130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863f97-1e1a-4884-8dfb-77f1792406f2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.404617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863f97-1e1a-4884-8dfb-77f1792406f2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.404711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863f97-1e1a-4884-8dfb-77f1792406f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.425693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-13863f97-1e1a-4884-8dfb-77f1792406f2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:57.425693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-13863f97-1e1a-4884-8dfb-77f1792406f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:57.503923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 926/1868] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:57.521607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52ef51-e0d8-47a7-bc74-bb4f3d8ab735 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.521802 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52ef51-e0d8-47a7-bc74-bb4f3d8ab735 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.522107 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52ef51-e0d8-47a7-bc74-bb4f3d8ab735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.557045 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-3e52ef51-e0d8-47a7-bc74-bb4f3d8ab735 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:57.559842 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3e52ef51-e0d8-47a7-bc74-bb4f3d8ab735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:57.568919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 943/1869] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:57.572979 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13863f97-1e1a-4884-8dfb-77f1792406f2 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.584435 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13863f97-1e1a-4884-8dfb-77f1792406f2 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.594771 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3966fa-1766-4a27-8ec3-23b4bbdcaacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.595587 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3966fa-1766-4a27-8ec3-23b4bbdcaacf admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.596075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3966fa-1766-4a27-8ec3-23b4bbdcaacf admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.596531 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3966fa-1766-4a27-8ec3-23b4bbdcaacf admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.597864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3966fa-1766-4a27-8ec3-23b4bbdcaacf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:38:57.598622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3966fa-1766-4a27-8ec3-23b4bbdcaacf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.601352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3966fa-1766-4a27-8ec3-23b4bbdcaacf admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.621003 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 927/1870] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:38:57.622348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52ef51-e0d8-47a7-bc74-bb4f3d8ab735 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.632578 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52ef51-e0d8-47a7-bc74-bb4f3d8ab735 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.638123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b263cb8-c3de-43db-8e3b-c31e7293c88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.638845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b263cb8-c3de-43db-8e3b-c31e7293c88b admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.639341 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b263cb8-c3de-43db-8e3b-c31e7293c88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.639626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b263cb8-c3de-43db-8e3b-c31e7293c88b admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.640521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b263cb8-c3de-43db-8e3b-c31e7293c88b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.642449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b263cb8-c3de-43db-8e3b-c31e7293c88b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.674947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 944/1871] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:57 2022] POST /identity/v3/projects => generated 401 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:38:57.675963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3966fa-1766-4a27-8ec3-23b4bbdcaacf admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.686824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3966fa-1766-4a27-8ec3-23b4bbdcaacf admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.760038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5393e2-fd7d-4ece-9c86-37af1574c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.760708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5393e2-fd7d-4ece-9c86-37af1574c426 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.760981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5393e2-fd7d-4ece-9c86-37af1574c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.761250 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5393e2-fd7d-4ece-9c86-37af1574c426 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.761992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5393e2-fd7d-4ece-9c86-37af1574c426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.764024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5393e2-fd7d-4ece-9c86-37af1574c426 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.791018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 928/1872] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:57 2022] POST /identity/v3/users => generated 301 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:57.792784 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b263cb8-c3de-43db-8e3b-c31e7293c88b admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.805964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b263cb8-c3de-43db-8e3b-c31e7293c88b admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.814600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00c55-4c37-4797-bd9e-3d2577f0d4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.815448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00c55-4c37-4797-bd9e-3d2577f0d4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.815718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00c55-4c37-4797-bd9e-3d2577f0d4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.815984 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00c55-4c37-4797-bd9e-3d2577f0d4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.816707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c00c55-4c37-4797-bd9e-3d2577f0d4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.820125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c00c55-4c37-4797-bd9e-3d2577f0d4fb admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.831468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 945/1873] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:57.835305 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5393e2-fd7d-4ece-9c86-37af1574c426 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.845025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5393e2-fd7d-4ece-9c86-37af1574c426 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.850228 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdd936-0fb2-4eb0-bf99-6487e979ffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.850889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdd936-0fb2-4eb0-bf99-6487e979ffb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.851199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdd936-0fb2-4eb0-bf99-6487e979ffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.851493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdd936-0fb2-4eb0-bf99-6487e979ffb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.852360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdd936-0fb2-4eb0-bf99-6487e979ffb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.854203 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdd936-0fb2-4eb0-bf99-6487e979ffb7 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.870806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 929/1874] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:57.872561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00c55-4c37-4797-bd9e-3d2577f0d4fb admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.891000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00c55-4c37-4797-bd9e-3d2577f0d4fb admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.895718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78838d79-36df-4564-859a-bf8cbb5f7be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.896612 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78838d79-36df-4564-859a-bf8cbb5f7be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.896911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78838d79-36df-4564-859a-bf8cbb5f7be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.897184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78838d79-36df-4564-859a-bf8cbb5f7be6 admin admin] PATH_INFO: `/v3/projects/f2360c6b0d01481ca45dd5c1f12d3352/users/4ca20597e8f3423d87d4312d80e75540/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.912488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78838d79-36df-4564-859a-bf8cbb5f7be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2360c6b0d01481ca45dd5c1f12d3352, user_id=4ca20597e8f3423d87d4312d80e75540, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.917414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78838d79-36df-4564-859a-bf8cbb5f7be6 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.933039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 946/1875] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:57 2022] PUT /identity/v3/projects/f2360c6b0d01481ca45dd5c1f12d3352/users/4ca20597e8f3423d87d4312d80e75540/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:57.943717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e94f6f-25ba-40e5-9ea7-8dffe44e7e8c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.944008 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e94f6f-25ba-40e5-9ea7-8dffe44e7e8c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.944286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e94f6f-25ba-40e5-9ea7-8dffe44e7e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.971034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-f5e94f6f-25ba-40e5-9ea7-8dffe44e7e8c None None] MFA Rules not processed for user `4ca20597e8f3423d87d4312d80e75540`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:57.972340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f5e94f6f-25ba-40e5-9ea7-8dffe44e7e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:58.047537 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 930/1876] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:58.048426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78838d79-36df-4564-859a-bf8cbb5f7be6 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:58.119692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78838d79-36df-4564-859a-bf8cbb5f7be6 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:58.128705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4700707-965a-4e85-ab66-81f1e40905c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:58.128705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700707-965a-4e85-ab66-81f1e40905c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.128705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700707-965a-4e85-ab66-81f1e40905c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.128705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700707-965a-4e85-ab66-81f1e40905c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.129083 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4700707-965a-4e85-ab66-81f1e40905c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:58.129718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4700707-965a-4e85-ab66-81f1e40905c5 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:58.162739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 947/1877] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:58 2022] POST /identity/v3/projects => generated 401 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:58.166751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e94f6f-25ba-40e5-9ea7-8dffe44e7e8c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:58.178359 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e94f6f-25ba-40e5-9ea7-8dffe44e7e8c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:58.246995 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291b2dc-14a1-4379-a6e7-563150a181b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:58.247764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291b2dc-14a1-4379-a6e7-563150a181b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.248159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291b2dc-14a1-4379-a6e7-563150a181b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.248526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291b2dc-14a1-4379-a6e7-563150a181b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.249502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291b2dc-14a1-4379-a6e7-563150a181b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:58.251915 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291b2dc-14a1-4379-a6e7-563150a181b4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:58.281314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 931/1878] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:58 2022] POST /identity/v3/users => generated 307 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:58.285047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4700707-965a-4e85-ab66-81f1e40905c5 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:58.297754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4700707-965a-4e85-ab66-81f1e40905c5 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:58.302908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd2b86-716d-4ed3-90ee-8f2a8aeda58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:58.303805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd2b86-716d-4ed3-90ee-8f2a8aeda58e admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.304096 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd2b86-716d-4ed3-90ee-8f2a8aeda58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.304378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd2b86-716d-4ed3-90ee-8f2a8aeda58e admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.305613 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd2b86-716d-4ed3-90ee-8f2a8aeda58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:58.307076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd2b86-716d-4ed3-90ee-8f2a8aeda58e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:58.318964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 948/1879] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:58.322835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291b2dc-14a1-4379-a6e7-563150a181b4 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:58.335839 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291b2dc-14a1-4379-a6e7-563150a181b4 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:58.341940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f64efb-2def-40e7-9d3e-fdf87c2f20cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:58.343085 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64efb-2def-40e7-9d3e-fdf87c2f20cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.343474 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64efb-2def-40e7-9d3e-fdf87c2f20cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.343947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64efb-2def-40e7-9d3e-fdf87c2f20cf admin admin] PATH_INFO: `/v3/projects/cd90eee232a94c86a3d4458c6c4b275f/users/137cd44d5c004be7b714967f3064f018/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.352344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd2b86-716d-4ed3-90ee-8f2a8aeda58e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:58.354289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a1fd2b86-716d-4ed3-90ee-8f2a8aeda58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:58.362638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f64efb-2def-40e7-9d3e-fdf87c2f20cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd90eee232a94c86a3d4458c6c4b275f, user_id=137cd44d5c004be7b714967f3064f018, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:58.365596 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f64efb-2def-40e7-9d3e-fdf87c2f20cf admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:58.377216 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd2b86-716d-4ed3-90ee-8f2a8aeda58e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:58.383121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 932/1880] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:58 2022] PUT /identity/v3/projects/cd90eee232a94c86a3d4458c6c4b275f/users/137cd44d5c004be7b714967f3064f018/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:58.387226 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f64efb-2def-40e7-9d3e-fdf87c2f20cf admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:58.445719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1982f-20c0-4bdf-a86f-6a1ea0141022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:58.446582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1982f-20c0-4bdf-a86f-6a1ea0141022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.446861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1982f-20c0-4bdf-a86f-6a1ea0141022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.447171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1982f-20c0-4bdf-a86f-6a1ea0141022 admin admin] PATH_INFO: `/v3/users/8be4839b150e45b4b693b19abd341099` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.448384 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1982f-20c0-4bdf-a86f-6a1ea0141022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be4839b150e45b4b693b19abd341099)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:58.450817 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1982f-20c0-4bdf-a86f-6a1ea0141022 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:58.455614 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f64efb-2def-40e7-9d3e-fdf87c2f20cf admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:58.460917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030b04a-4945-439d-b646-e2cc7dcc8236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:58.461688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030b04a-4945-439d-b646-e2cc7dcc8236 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.462252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030b04a-4945-439d-b646-e2cc7dcc8236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.462640 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030b04a-4945-439d-b646-e2cc7dcc8236 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.464948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030b04a-4945-439d-b646-e2cc7dcc8236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:58.467176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030b04a-4945-439d-b646-e2cc7dcc8236 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:58.479701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 933/1881] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:58.484023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030b04a-4945-439d-b646-e2cc7dcc8236 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:58.495463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030b04a-4945-439d-b646-e2cc7dcc8236 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:58.501377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f2bf7-1825-42de-b361-364aca6878c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:58.502501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f2bf7-1825-42de-b361-364aca6878c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.503009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f2bf7-1825-42de-b361-364aca6878c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.503143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f8e1982f-20c0-4bdf-a86f-6a1ea0141022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be4839b150e45b4b693b19abd341099'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:58.503635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f2bf7-1825-42de-b361-364aca6878c8 admin admin] PATH_INFO: `/v3/projects/cd90eee232a94c86a3d4458c6c4b275f/users/137cd44d5c004be7b714967f3064f018/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.504626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f8e1982f-20c0-4bdf-a86f-6a1ea0141022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be4839b150e45b4b693b19abd341099'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:58.505250 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f8e1982f-20c0-4bdf-a86f-6a1ea0141022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be4839b150e45b4b693b19abd341099'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:58.506265 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f2bf7-1825-42de-b361-364aca6878c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd90eee232a94c86a3d4458c6c4b275f, user_id=137cd44d5c004be7b714967f3064f018, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:58.509603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f2bf7-1825-42de-b361-364aca6878c8 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:58.519110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f8e1982f-20c0-4bdf-a86f-6a1ea0141022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be4839b150e45b4b693b19abd341099'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:58.522296 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 934/1882] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:58 2022] PUT /identity/v3/projects/cd90eee232a94c86a3d4458c6c4b275f/users/137cd44d5c004be7b714967f3064f018/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:58.535609 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74986b-b271-4a60-9252-95212f3b2613 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.536090 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74986b-b271-4a60-9252-95212f3b2613 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.536548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74986b-b271-4a60-9252-95212f3b2613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.538046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f8e1982f-20c0-4bdf-a86f-6a1ea0141022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be4839b150e45b4b693b19abd341099'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:58.554156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 949/1883] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:58 2022] DELETE /identity/v3/users/8be4839b150e45b4b693b19abd341099 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:58.558486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9d6a7-6538-404c-9266-dcb617024e4d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.558818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9d6a7-6538-404c-9266-dcb617024e4d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.559222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9d6a7-6538-404c-9266-dcb617024e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.565615 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ff74986b-b271-4a60-9252-95212f3b2613 None None] MFA Rules not processed for user `137cd44d5c004be7b714967f3064f018`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:58.566930 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ff74986b-b271-4a60-9252-95212f3b2613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:58.580067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-30b9d6a7-6538-404c-9266-dcb617024e4d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:58.581270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-30b9d6a7-6538-404c-9266-dcb617024e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:58.660766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 935/1884] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:58 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:58.670082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 950/1885] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:58.672119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74986b-b271-4a60-9252-95212f3b2613 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:58.673946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ff74986b-b271-4a60-9252-95212f3b2613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:58.680039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9d6a7-6538-404c-9266-dcb617024e4d None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:58.681991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-30b9d6a7-6538-404c-9266-dcb617024e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:58.731057 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74986b-b271-4a60-9252-95212f3b2613 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:58.734698 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b82e3-9175-4e88-8b5d-f770b6722d78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:58.735369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b82e3-9175-4e88-8b5d-f770b6722d78 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.735644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b82e3-9175-4e88-8b5d-f770b6722d78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.735911 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b82e3-9175-4e88-8b5d-f770b6722d78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.744767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b82e3-9175-4e88-8b5d-f770b6722d78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:58.746351 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b82e3-9175-4e88-8b5d-f770b6722d78 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:58.753734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9d6a7-6538-404c-9266-dcb617024e4d None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:58.755429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 936/1886] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:58.757944 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6df090-a154-48ad-b6c3-2acae2737a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:58.758579 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6df090-a154-48ad-b6c3-2acae2737a85 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.758861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6df090-a154-48ad-b6c3-2acae2737a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.759337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6df090-a154-48ad-b6c3-2acae2737a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.769041 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6df090-a154-48ad-b6c3-2acae2737a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:58.770640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6df090-a154-48ad-b6c3-2acae2737a85 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:58.781515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 951/1887] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:58.832216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b82e3-9175-4e88-8b5d-f770b6722d78 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:58.840672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b82e3-9175-4e88-8b5d-f770b6722d78 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:58.844520 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5527d-12bf-4188-8b07-e3a88e29204e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:58.845153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5527d-12bf-4188-8b07-e3a88e29204e service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:58.845439 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5527d-12bf-4188-8b07-e3a88e29204e service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:58.845700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5527d-12bf-4188-8b07-e3a88e29204e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:58.847553 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-03d5527d-12bf-4188-8b07-e3a88e29204e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:58.912806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5527d-12bf-4188-8b07-e3a88e29204e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:58.914378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5527d-12bf-4188-8b07-e3a88e29204e service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:58.923657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 937/1888] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:59.049899 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6df090-a154-48ad-b6c3-2acae2737a85 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:59.051500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fd6df090-a154-48ad-b6c3-2acae2737a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:59.069256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6df090-a154-48ad-b6c3-2acae2737a85 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:59.076482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:59.077372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:59.077610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:59.089572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] PATH_INFO: `/v3/projects/e31d3dbe12a04b9e90ff29f95c180f60` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:59.091039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31d3dbe12a04b9e90ff29f95c180f60)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:59.096187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:59.145694 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31d3dbe12a04b9e90ff29f95c180f60', 'request_id': 'req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.151349 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31d3dbe12a04b9e90ff29f95c180f60', 'request_id': 'req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.158214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31d3dbe12a04b9e90ff29f95c180f60', 'request_id': 'req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.181835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] The token cache is being invalidate because project e31d3dbe12a04b9e90ff29f95c180f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:59.182133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.182800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.186948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 952/1889] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:59 2022] DELETE /identity/v3/projects/e31d3dbe12a04b9e90ff29f95c180f60 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:59.189440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5527d-12bf-4188-8b07-e3a88e29204e service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:59.203360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5527d-12bf-4188-8b07-e3a88e29204e service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:59.269491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee3205-9a9e-4d73-8de0-e6cd5a7ffca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:59.270269 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3205-9a9e-4d73-8de0-e6cd5a7ffca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:59.270545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3205-9a9e-4d73-8de0-e6cd5a7ffca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:59.270819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3205-9a9e-4d73-8de0-e6cd5a7ffca7 admin admin] PATH_INFO: `/v3/users/0a2ad0f3122a4565b13c5f5d1310c6a8` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:59.272039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee3205-9a9e-4d73-8de0-e6cd5a7ffca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2ad0f3122a4565b13c5f5d1310c6a8)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:59.273979 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee3205-9a9e-4d73-8de0-e6cd5a7ffca7 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:59.316388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-37ee3205-9a9e-4d73-8de0-e6cd5a7ffca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2ad0f3122a4565b13c5f5d1310c6a8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.317025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-37ee3205-9a9e-4d73-8de0-e6cd5a7ffca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2ad0f3122a4565b13c5f5d1310c6a8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.328295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-37ee3205-9a9e-4d73-8de0-e6cd5a7ffca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2ad0f3122a4565b13c5f5d1310c6a8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.336025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-37ee3205-9a9e-4d73-8de0-e6cd5a7ffca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2ad0f3122a4565b13c5f5d1310c6a8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.342823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-37ee3205-9a9e-4d73-8de0-e6cd5a7ffca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2ad0f3122a4565b13c5f5d1310c6a8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.348681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 938/1890] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:59 2022] DELETE /identity/v3/users/0a2ad0f3122a4565b13c5f5d1310c6a8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:59.694688 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:59.696380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:59.713019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7579c-a6a0-4f02-9e8f-5e4974f75ef1 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:59.774453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:59.775589 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:59.776177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:59.776613 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] PATH_INFO: `/v3/projects/e4722c61c162418fa5265041df7a28f2` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:59.778668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4722c61c162418fa5265041df7a28f2)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:59.780751 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:59.830668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4722c61c162418fa5265041df7a28f2', 'request_id': 'req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.836132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4722c61c162418fa5265041df7a28f2', 'request_id': 'req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.844068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4722c61c162418fa5265041df7a28f2', 'request_id': 'req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.863654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] The token cache is being invalidate because project e4722c61c162418fa5265041df7a28f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:59.863949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.864636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f90771cb-f92d-4c26-859d-a2bc9b8bd4cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:59.866255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 953/1891] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:59 2022] DELETE /identity/v3/projects/e4722c61c162418fa5265041df7a28f2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:59.871235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9654c-ddf9-4726-ac38-9d500f61eb6d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:59.871714 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9654c-ddf9-4726-ac38-9d500f61eb6d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:59.871813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9654c-ddf9-4726-ac38-9d500f61eb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:59.890004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-36b9654c-ddf9-4726-ac38-9d500f61eb6d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:59.891247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-36b9654c-ddf9-4726-ac38-9d500f61eb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:59.950457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 939/1892] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:38:59.958502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43922a6-6250-4171-bd14-2fc08e77155d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:59.958789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43922a6-6250-4171-bd14-2fc08e77155d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:59.959106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43922a6-6250-4171-bd14-2fc08e77155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:59.977867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-b43922a6-6250-4171-bd14-2fc08e77155d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:59.979095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-b43922a6-6250-4171-bd14-2fc08e77155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:59.987047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 954/1893] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:59.991350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9654c-ddf9-4726-ac38-9d500f61eb6d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.001012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9654c-ddf9-4726-ac38-9d500f61eb6d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.005544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded1ef8-801f-409e-9597-773be565a23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.006188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded1ef8-801f-409e-9597-773be565a23d admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.006467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded1ef8-801f-409e-9597-773be565a23d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.007022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded1ef8-801f-409e-9597-773be565a23d admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.007738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded1ef8-801f-409e-9597-773be565a23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:00.008044 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded1ef8-801f-409e-9597-773be565a23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.009646 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded1ef8-801f-409e-9597-773be565a23d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.021480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 940/1894] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:00.025640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43922a6-6250-4171-bd14-2fc08e77155d None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.035616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43922a6-6250-4171-bd14-2fc08e77155d None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.040236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c086034-a456-49a6-8e79-36545a90c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.040874 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c086034-a456-49a6-8e79-36545a90c5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.041156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c086034-a456-49a6-8e79-36545a90c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.041454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c086034-a456-49a6-8e79-36545a90c5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.042121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c086034-a456-49a6-8e79-36545a90c5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.044065 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c086034-a456-49a6-8e79-36545a90c5c0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.068102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 955/1895] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:00 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:00.072291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded1ef8-801f-409e-9597-773be565a23d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.082793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded1ef8-801f-409e-9597-773be565a23d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.138681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187809f-335e-4f2f-b331-d62be2081eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.139376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187809f-335e-4f2f-b331-d62be2081eea admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.139661 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187809f-335e-4f2f-b331-d62be2081eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.139942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187809f-335e-4f2f-b331-d62be2081eea admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.140634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187809f-335e-4f2f-b331-d62be2081eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.142534 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187809f-335e-4f2f-b331-d62be2081eea admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.162182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 941/1896] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:00 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:00.166191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c086034-a456-49a6-8e79-36545a90c5c0 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.176381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c086034-a456-49a6-8e79-36545a90c5c0 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.180938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264afcb-6f8c-48f7-a51c-7bef9e051040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.181576 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264afcb-6f8c-48f7-a51c-7bef9e051040 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.181854 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264afcb-6f8c-48f7-a51c-7bef9e051040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.182125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264afcb-6f8c-48f7-a51c-7bef9e051040 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.182838 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264afcb-6f8c-48f7-a51c-7bef9e051040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.184515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264afcb-6f8c-48f7-a51c-7bef9e051040 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.194477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 956/1897] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:00.198152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187809f-335e-4f2f-b331-d62be2081eea admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.208742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187809f-335e-4f2f-b331-d62be2081eea admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.213299 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6893828-f56e-40f3-853a-68d69cdffdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.213942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893828-f56e-40f3-853a-68d69cdffdea admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.214224 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893828-f56e-40f3-853a-68d69cdffdea admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.214498 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893828-f56e-40f3-853a-68d69cdffdea admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.215864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6893828-f56e-40f3-853a-68d69cdffdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.217479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6893828-f56e-40f3-853a-68d69cdffdea admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.227286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 942/1898] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:00.231206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264afcb-6f8c-48f7-a51c-7bef9e051040 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.240958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264afcb-6f8c-48f7-a51c-7bef9e051040 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.245863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bf494-728c-40c8-b97a-b27a51ec3694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.246731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bf494-728c-40c8-b97a-b27a51ec3694 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.247060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bf494-728c-40c8-b97a-b27a51ec3694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.247337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bf494-728c-40c8-b97a-b27a51ec3694 admin admin] PATH_INFO: `/v3/projects/781525e7ecf84c7c8b14d99f1fbd3c9d/users/5886587e30094f1d8c150b9c85049472/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.267368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bf494-728c-40c8-b97a-b27a51ec3694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781525e7ecf84c7c8b14d99f1fbd3c9d, user_id=5886587e30094f1d8c150b9c85049472, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.270096 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bf494-728c-40c8-b97a-b27a51ec3694 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.283616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 957/1899] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:00 2022] PUT /identity/v3/projects/781525e7ecf84c7c8b14d99f1fbd3c9d/users/5886587e30094f1d8c150b9c85049472/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:00.295540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a5690-2572-4219-995f-5f6d2ee1342a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.295715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a5690-2572-4219-995f-5f6d2ee1342a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.296106 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a5690-2572-4219-995f-5f6d2ee1342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.322116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-fb3a5690-2572-4219-995f-5f6d2ee1342a None None] MFA Rules not processed for user `5886587e30094f1d8c150b9c85049472`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:00.323370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-fb3a5690-2572-4219-995f-5f6d2ee1342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:00.383353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 943/1900] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:00.388573 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bf494-728c-40c8-b97a-b27a51ec3694 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.453381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bf494-728c-40c8-b97a-b27a51ec3694 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.459073 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043306c-63a0-455c-81d0-b71e0ad68848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.459859 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043306c-63a0-455c-81d0-b71e0ad68848 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.460184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043306c-63a0-455c-81d0-b71e0ad68848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.460495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043306c-63a0-455c-81d0-b71e0ad68848 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.461179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043306c-63a0-455c-81d0-b71e0ad68848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.463156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043306c-63a0-455c-81d0-b71e0ad68848 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.490983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 958/1901] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:00 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:00.492154 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a5690-2572-4219-995f-5f6d2ee1342a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.503207 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a5690-2572-4219-995f-5f6d2ee1342a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.557263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2a5ff-9bbc-42e4-8a44-6bf939b00b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.557837 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2a5ff-9bbc-42e4-8a44-6bf939b00b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.558116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2a5ff-9bbc-42e4-8a44-6bf939b00b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.558383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2a5ff-9bbc-42e4-8a44-6bf939b00b0b admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.559617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2a5ff-9bbc-42e4-8a44-6bf939b00b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.561508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2a5ff-9bbc-42e4-8a44-6bf939b00b0b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.581467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 944/1902] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:00 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:00.585330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043306c-63a0-455c-81d0-b71e0ad68848 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.595430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043306c-63a0-455c-81d0-b71e0ad68848 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.600031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a629f-e840-4800-81b9-36a47c65e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.600713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a629f-e840-4800-81b9-36a47c65e2ea admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.601001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a629f-e840-4800-81b9-36a47c65e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.601279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a629f-e840-4800-81b9-36a47c65e2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.601999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a629f-e840-4800-81b9-36a47c65e2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.603852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a629f-e840-4800-81b9-36a47c65e2ea admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.614047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 959/1903] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:00.618092 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2a5ff-9bbc-42e4-8a44-6bf939b00b0b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.628422 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2a5ff-9bbc-42e4-8a44-6bf939b00b0b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.633542 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4793a8-4c30-40cd-83bc-47b953b2fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.634408 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4793a8-4c30-40cd-83bc-47b953b2fb0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.634688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4793a8-4c30-40cd-83bc-47b953b2fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.634997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4793a8-4c30-40cd-83bc-47b953b2fb0f admin admin] PATH_INFO: `/v3/projects/3b153ec0ac4143159066d14741a5dfaa/users/fc2821005e52490faad9ead5b9767276/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.650199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4793a8-4c30-40cd-83bc-47b953b2fb0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b153ec0ac4143159066d14741a5dfaa, user_id=fc2821005e52490faad9ead5b9767276, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.652850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4793a8-4c30-40cd-83bc-47b953b2fb0f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.666824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 945/1904] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:00 2022] PUT /identity/v3/projects/3b153ec0ac4143159066d14741a5dfaa/users/fc2821005e52490faad9ead5b9767276/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:00.671506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a629f-e840-4800-81b9-36a47c65e2ea admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.681675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a629f-e840-4800-81b9-36a47c65e2ea admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.754050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07e93c-f772-4489-bfda-b4e75b544181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.754718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07e93c-f772-4489-bfda-b4e75b544181 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.755043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07e93c-f772-4489-bfda-b4e75b544181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.755318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07e93c-f772-4489-bfda-b4e75b544181 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.756043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07e93c-f772-4489-bfda-b4e75b544181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.758039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07e93c-f772-4489-bfda-b4e75b544181 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.769792 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 960/1905] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:00.773963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4793a8-4c30-40cd-83bc-47b953b2fb0f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.786649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4793a8-4c30-40cd-83bc-47b953b2fb0f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.793533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c059d-872e-4a89-bb93-540c9c224da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.794513 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c059d-872e-4a89-bb93-540c9c224da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.795055 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c059d-872e-4a89-bb93-540c9c224da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.795295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c059d-872e-4a89-bb93-540c9c224da2 admin admin] PATH_INFO: `/v3/projects/3b153ec0ac4143159066d14741a5dfaa/users/fc2821005e52490faad9ead5b9767276/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.797875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c059d-872e-4a89-bb93-540c9c224da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b153ec0ac4143159066d14741a5dfaa, user_id=fc2821005e52490faad9ead5b9767276, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.804631 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c059d-872e-4a89-bb93-540c9c224da2 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.817008 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 946/1906] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:00 2022] PUT /identity/v3/projects/3b153ec0ac4143159066d14741a5dfaa/users/fc2821005e52490faad9ead5b9767276/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:00.828453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf23e7-d5eb-48ca-bb0b-a36800848d98 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.829056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf23e7-d5eb-48ca-bb0b-a36800848d98 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.829056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf23e7-d5eb-48ca-bb0b-a36800848d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.861226 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c3cf23e7-d5eb-48ca-bb0b-a36800848d98 None None] MFA Rules not processed for user `fc2821005e52490faad9ead5b9767276`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:00.862431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c3cf23e7-d5eb-48ca-bb0b-a36800848d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:00.938158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 961/1907] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:00.951183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c059d-872e-4a89-bb93-540c9c224da2 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.953172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-af4c059d-872e-4a89-bb93-540c9c224da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:01.017902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c059d-872e-4a89-bb93-540c9c224da2 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:01.021565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeed748-fd94-4184-8217-a949aeb52fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:01.022200 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeed748-fd94-4184-8217-a949aeb52fda service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.022477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeed748-fd94-4184-8217-a949aeb52fda service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.022740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeed748-fd94-4184-8217-a949aeb52fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.032241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeed748-fd94-4184-8217-a949aeb52fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:01.033661 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeed748-fd94-4184-8217-a949aeb52fda service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:01.042957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 947/1908] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:01.088017 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf23e7-d5eb-48ca-bb0b-a36800848d98 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:01.089642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c3cf23e7-d5eb-48ca-bb0b-a36800848d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:01.102920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf23e7-d5eb-48ca-bb0b-a36800848d98 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:01.107404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22882d3f-290d-4f52-bea2-26048437617a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:01.108132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22882d3f-290d-4f52-bea2-26048437617a service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.108359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22882d3f-290d-4f52-bea2-26048437617a service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.108637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22882d3f-290d-4f52-bea2-26048437617a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.188505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22882d3f-290d-4f52-bea2-26048437617a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:01.190043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22882d3f-290d-4f52-bea2-26048437617a service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:01.203832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 962/1909] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:01.883522 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeed748-fd94-4184-8217-a949aeb52fda service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:01.885519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0eeed748-fd94-4184-8217-a949aeb52fda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:01.973349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeed748-fd94-4184-8217-a949aeb52fda service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:01.986831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:01.987986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.988344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.988700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] PATH_INFO: `/v3/users/696ca64116714456a8ae841b5ed76f84` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.991417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=696ca64116714456a8ae841b5ed76f84)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:01.993750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:02.075829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696ca64116714456a8ae841b5ed76f84'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:02.076929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696ca64116714456a8ae841b5ed76f84'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:02.125482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696ca64116714456a8ae841b5ed76f84'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:02.135997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696ca64116714456a8ae841b5ed76f84'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:02.144752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696ca64116714456a8ae841b5ed76f84'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:02.151650 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 948/1910] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:01 2022] DELETE /identity/v3/users/696ca64116714456a8ae841b5ed76f84 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:02.156508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb00a3-1994-4580-a3bb-da34f90d6d39 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.156993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb00a3-1994-4580-a3bb-da34f90d6d39 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.157099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb00a3-1994-4580-a3bb-da34f90d6d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.185192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-37cb00a3-1994-4580-a3bb-da34f90d6d39 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:02.186640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-37cb00a3-1994-4580-a3bb-da34f90d6d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:02.249469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 963/1911] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:02.259372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:02.261004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:02.343857 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969cca5-bad5-485e-a1cb-e8b716a64a4c admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:02.348217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a108-7b27-4b7a-a0fa-062cf709c6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:02.348872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a108-7b27-4b7a-a0fa-062cf709c6fb service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.349156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a108-7b27-4b7a-a0fa-062cf709c6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.349432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a108-7b27-4b7a-a0fa-062cf709c6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.360867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1a108-7b27-4b7a-a0fa-062cf709c6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:02.362395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1a108-7b27-4b7a-a0fa-062cf709c6fb service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:02.373696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 949/1912] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:02.801120 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb00a3-1994-4580-a3bb-da34f90d6d39 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:02.803243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-37cb00a3-1994-4580-a3bb-da34f90d6d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:02.827764 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb00a3-1994-4580-a3bb-da34f90d6d39 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:02.834023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:02.837574 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.842712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.843883 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] PATH_INFO: `/v3/projects/f881e1a1977f4441b63f2b0fba7791b5` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.846070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f881e1a1977f4441b63f2b0fba7791b5)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:02.876790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:03.009850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f881e1a1977f4441b63f2b0fba7791b5', 'request_id': 'req-5a53b1e4-569f-4f32-8297-a6105eed147d'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:03.016169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f881e1a1977f4441b63f2b0fba7791b5', 'request_id': 'req-5a53b1e4-569f-4f32-8297-a6105eed147d'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:03.023211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f881e1a1977f4441b63f2b0fba7791b5', 'request_id': 'req-5a53b1e4-569f-4f32-8297-a6105eed147d'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:03.045029 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] The token cache is being invalidate because project f881e1a1977f4441b63f2b0fba7791b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:03.045424 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:03.046375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5a53b1e4-569f-4f32-8297-a6105eed147d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:03.048464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 964/1913] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:02 2022] DELETE /identity/v3/projects/f881e1a1977f4441b63f2b0fba7791b5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:03.055742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629671-6f57-4901-beb8-f117c4ced3bf None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:03.056195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629671-6f57-4901-beb8-f117c4ced3bf None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:03.056481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629671-6f57-4901-beb8-f117c4ced3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:03.079045 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-84629671-6f57-4901-beb8-f117c4ced3bf None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:03.081693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-84629671-6f57-4901-beb8-f117c4ced3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:03.159925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 950/1914] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:03.172628 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b50d-9b66-4aad-8c36-372fcfd2ecb2 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:03.173145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b50d-9b66-4aad-8c36-372fcfd2ecb2 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:03.173239 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b50d-9b66-4aad-8c36-372fcfd2ecb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:03.196055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f004b50d-9b66-4aad-8c36-372fcfd2ecb2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:03.197566 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f004b50d-9b66-4aad-8c36-372fcfd2ecb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:03.215615 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 965/1915] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:03.220499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629671-6f57-4901-beb8-f117c4ced3bf None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:03.232565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629671-6f57-4901-beb8-f117c4ced3bf None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:03.238040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6a877-5665-442c-a4a5-e0d65e45fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:03.239084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6a877-5665-442c-a4a5-e0d65e45fb83 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:03.239532 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6a877-5665-442c-a4a5-e0d65e45fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:03.239968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6a877-5665-442c-a4a5-e0d65e45fb83 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:03.241037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6a877-5665-442c-a4a5-e0d65e45fb83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:03.241543 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6a877-5665-442c-a4a5-e0d65e45fb83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:03.243515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6a877-5665-442c-a4a5-e0d65e45fb83 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:03.261020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 951/1916] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:39:03.265290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004b50d-9b66-4aad-8c36-372fcfd2ecb2 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:03.277697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004b50d-9b66-4aad-8c36-372fcfd2ecb2 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:03.282962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b986b-7bc5-4676-b57c-e62abb55e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:03.283805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b986b-7bc5-4676-b57c-e62abb55e57f admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:03.284081 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b986b-7bc5-4676-b57c-e62abb55e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:03.284534 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b986b-7bc5-4676-b57c-e62abb55e57f admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:03.285328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b986b-7bc5-4676-b57c-e62abb55e57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:03.287390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b986b-7bc5-4676-b57c-e62abb55e57f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:03.332496 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 966/1917] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:03 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:03.333957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6a877-5665-442c-a4a5-e0d65e45fb83 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:03.346714 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6a877-5665-442c-a4a5-e0d65e45fb83 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:03.429249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc05dff-22a2-4bd6-9804-8a8d940ef57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:03.430203 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc05dff-22a2-4bd6-9804-8a8d940ef57a admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:03.430651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc05dff-22a2-4bd6-9804-8a8d940ef57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:03.430963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc05dff-22a2-4bd6-9804-8a8d940ef57a admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:03.431654 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc05dff-22a2-4bd6-9804-8a8d940ef57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:03.433581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc05dff-22a2-4bd6-9804-8a8d940ef57a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:03.453778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 952/1918] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:03 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:03.457895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b986b-7bc5-4676-b57c-e62abb55e57f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:03.470360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b986b-7bc5-4676-b57c-e62abb55e57f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:03.475197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553e3ad-b657-4c08-9b11-fa817741b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:03.475854 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553e3ad-b657-4c08-9b11-fa817741b719 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:03.476142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553e3ad-b657-4c08-9b11-fa817741b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:03.476412 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553e3ad-b657-4c08-9b11-fa817741b719 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:03.477323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553e3ad-b657-4c08-9b11-fa817741b719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:03.478923 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553e3ad-b657-4c08-9b11-fa817741b719 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:03.491230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 967/1919] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:03.493948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc05dff-22a2-4bd6-9804-8a8d940ef57a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:03.504692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc05dff-22a2-4bd6-9804-8a8d940ef57a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:03.510928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571e6f4-6548-449a-97bd-750ca70eb631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:03.511678 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571e6f4-6548-449a-97bd-750ca70eb631 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:03.511966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571e6f4-6548-449a-97bd-750ca70eb631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:03.512243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571e6f4-6548-449a-97bd-750ca70eb631 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:03.513096 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571e6f4-6548-449a-97bd-750ca70eb631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:03.515088 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571e6f4-6548-449a-97bd-750ca70eb631 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:03.526021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 953/1920] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:03.531156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553e3ad-b657-4c08-9b11-fa817741b719 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:03.541221 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553e3ad-b657-4c08-9b11-fa817741b719 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:03.547146 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b3053-ec46-4bc6-b85b-62d70c4c7564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:03.548259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b3053-ec46-4bc6-b85b-62d70c4c7564 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:03.548543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b3053-ec46-4bc6-b85b-62d70c4c7564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:03.548818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b3053-ec46-4bc6-b85b-62d70c4c7564 admin admin] PATH_INFO: `/v3/projects/5db6f7b7be0449af84838ab4670471b7/users/e11a5132c4804c8f858d8058678ca834/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:03.565137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b3053-ec46-4bc6-b85b-62d70c4c7564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db6f7b7be0449af84838ab4670471b7, user_id=e11a5132c4804c8f858d8058678ca834, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:03.568220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b3053-ec46-4bc6-b85b-62d70c4c7564 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:03.583917 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 968/1921] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:03 2022] PUT /identity/v3/projects/5db6f7b7be0449af84838ab4670471b7/users/e11a5132c4804c8f858d8058678ca834/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:03.596439 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b89b83-afe3-41b3-bb1f-ebe92df2e947 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:03.597049 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b89b83-afe3-41b3-bb1f-ebe92df2e947 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:03.597369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b89b83-afe3-41b3-bb1f-ebe92df2e947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:03.651324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-76b89b83-afe3-41b3-bb1f-ebe92df2e947 None None] MFA Rules not processed for user `e11a5132c4804c8f858d8058678ca834`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:03.653199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-76b89b83-afe3-41b3-bb1f-ebe92df2e947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:03.770228 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 954/1922] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:03.775852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b3053-ec46-4bc6-b85b-62d70c4c7564 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:03.858405 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b3053-ec46-4bc6-b85b-62d70c4c7564 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:03.864344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6c4b4-3f74-402c-b01d-09452fdcc7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:03.865002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6c4b4-3f74-402c-b01d-09452fdcc7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:03.865454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6c4b4-3f74-402c-b01d-09452fdcc7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:03.865744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6c4b4-3f74-402c-b01d-09452fdcc7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:03.866437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6c4b4-3f74-402c-b01d-09452fdcc7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:03.868924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6c4b4-3f74-402c-b01d-09452fdcc7e2 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:03.907102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 969/1923] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:03 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:03.911045 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b89b83-afe3-41b3-bb1f-ebe92df2e947 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:03.931148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b89b83-afe3-41b3-bb1f-ebe92df2e947 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:04.000688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52d00a-e450-40f3-b6d4-9a857020aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:04.001542 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52d00a-e450-40f3-b6d4-9a857020aae4 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.001923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52d00a-e450-40f3-b6d4-9a857020aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.002266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52d00a-e450-40f3-b6d4-9a857020aae4 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.003089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52d00a-e450-40f3-b6d4-9a857020aae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:04.009122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52d00a-e450-40f3-b6d4-9a857020aae4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:04.043048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 955/1924] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:03 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:04.044299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6c4b4-3f74-402c-b01d-09452fdcc7e2 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:04.058086 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6c4b4-3f74-402c-b01d-09452fdcc7e2 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:04.065169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6804c-16ea-485b-a351-9c3a875c3d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:04.066134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6804c-16ea-485b-a351-9c3a875c3d85 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.066423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6804c-16ea-485b-a351-9c3a875c3d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.066701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6804c-16ea-485b-a351-9c3a875c3d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.067475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6804c-16ea-485b-a351-9c3a875c3d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:04.069893 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6804c-16ea-485b-a351-9c3a875c3d85 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:04.097586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 970/1925] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:04.101709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52d00a-e450-40f3-b6d4-9a857020aae4 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:04.112669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52d00a-e450-40f3-b6d4-9a857020aae4 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:04.117940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22963bc-4f29-42cd-811b-0d033c8c6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:04.118715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22963bc-4f29-42cd-811b-0d033c8c6a50 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.119135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22963bc-4f29-42cd-811b-0d033c8c6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.119479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22963bc-4f29-42cd-811b-0d033c8c6a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.120284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22963bc-4f29-42cd-811b-0d033c8c6a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:04.122680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22963bc-4f29-42cd-811b-0d033c8c6a50 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:04.134370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 956/1926] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:04.139390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6804c-16ea-485b-a351-9c3a875c3d85 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:04.150367 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6804c-16ea-485b-a351-9c3a875c3d85 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:04.155856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955683bc-0b91-4aab-a772-e89141b93012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:04.157047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955683bc-0b91-4aab-a772-e89141b93012 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.158240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955683bc-0b91-4aab-a772-e89141b93012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.158240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955683bc-0b91-4aab-a772-e89141b93012 admin admin] PATH_INFO: `/v3/projects/54cebbea91184fa887fff6097e954d3f/users/7de874187f9b487da07fc63073ceb5f8/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.177973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955683bc-0b91-4aab-a772-e89141b93012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cebbea91184fa887fff6097e954d3f, user_id=7de874187f9b487da07fc63073ceb5f8, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:04.181939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955683bc-0b91-4aab-a772-e89141b93012 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:04.207737 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 971/1927] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:04 2022] PUT /identity/v3/projects/54cebbea91184fa887fff6097e954d3f/users/7de874187f9b487da07fc63073ceb5f8/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:04.219504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79a80f-1642-4e9f-829e-99e988915254 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.219982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79a80f-1642-4e9f-829e-99e988915254 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.220391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79a80f-1642-4e9f-829e-99e988915254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.275546 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-cb79a80f-1642-4e9f-829e-99e988915254 None None] MFA Rules not processed for user `7de874187f9b487da07fc63073ceb5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:04.276994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-cb79a80f-1642-4e9f-829e-99e988915254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:04.433230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 957/1928] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:04.434163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955683bc-0b91-4aab-a772-e89141b93012 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:04.540190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79a80f-1642-4e9f-829e-99e988915254 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:04.542506 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-cb79a80f-1642-4e9f-829e-99e988915254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:04.543343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955683bc-0b91-4aab-a772-e89141b93012 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:04.548381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f0001-5693-4a94-acf8-c9e9d546819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:04.549314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f0001-5693-4a94-acf8-c9e9d546819e admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.549662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f0001-5693-4a94-acf8-c9e9d546819e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.550004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f0001-5693-4a94-acf8-c9e9d546819e admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.550771 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f0001-5693-4a94-acf8-c9e9d546819e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:04.552756 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f0001-5693-4a94-acf8-c9e9d546819e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:04.560388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79a80f-1642-4e9f-829e-99e988915254 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:04.567301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3952172-de3e-47a3-9fcb-9e75a5c75cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:04.568172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3952172-de3e-47a3-9fcb-9e75a5c75cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.568450 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3952172-de3e-47a3-9fcb-9e75a5c75cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.568724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3952172-de3e-47a3-9fcb-9e75a5c75cda admin admin] PATH_INFO: `/v3/users/4ca20597e8f3423d87d4312d80e75540` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.570043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3952172-de3e-47a3-9fcb-9e75a5c75cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca20597e8f3423d87d4312d80e75540)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:04.572046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3952172-de3e-47a3-9fcb-9e75a5c75cda admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:04.604549 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 972/1929] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:04 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:04.609702 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f0001-5693-4a94-acf8-c9e9d546819e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:04.639998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3952172-de3e-47a3-9fcb-9e75a5c75cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca20597e8f3423d87d4312d80e75540'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:04.640685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3952172-de3e-47a3-9fcb-9e75a5c75cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca20597e8f3423d87d4312d80e75540'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:04.656268 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3952172-de3e-47a3-9fcb-9e75a5c75cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca20597e8f3423d87d4312d80e75540'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:04.680429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3952172-de3e-47a3-9fcb-9e75a5c75cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca20597e8f3423d87d4312d80e75540'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:04.689822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f0001-5693-4a94-acf8-c9e9d546819e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:04.698175 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d49e1-1c3c-4f10-9939-fae143cb92e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:04.698557 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b3952172-de3e-47a3-9fcb-9e75a5c75cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca20597e8f3423d87d4312d80e75540'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:04.699689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d49e1-1c3c-4f10-9939-fae143cb92e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.700117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d49e1-1c3c-4f10-9939-fae143cb92e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.701243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d49e1-1c3c-4f10-9939-fae143cb92e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.703636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d49e1-1c3c-4f10-9939-fae143cb92e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:04.706494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 958/1930] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:04 2022] DELETE /identity/v3/users/4ca20597e8f3423d87d4312d80e75540 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:04.710983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d49e1-1c3c-4f10-9939-fae143cb92e4 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:04.711420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaddab-935f-4225-95de-9e18be578462 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.711713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaddab-935f-4225-95de-9e18be578462 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.712039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaddab-935f-4225-95de-9e18be578462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.737217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-befaddab-935f-4225-95de-9e18be578462 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:04.739265 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-befaddab-935f-4225-95de-9e18be578462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:04.753794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 973/1931] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:04 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:04.758936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d49e1-1c3c-4f10-9939-fae143cb92e4 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:04.761669 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6c2d49e1-1c3c-4f10-9939-fae143cb92e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:04.790102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d49e1-1c3c-4f10-9939-fae143cb92e4 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:04.847479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 959/1932] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:04.857605 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befaddab-935f-4225-95de-9e18be578462 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:04.860509 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-befaddab-935f-4225-95de-9e18be578462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:04.873635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516f001-e71c-4fc2-bdcc-8eef1e884b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:04.874356 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516f001-e71c-4fc2-bdcc-8eef1e884b60 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.874784 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516f001-e71c-4fc2-bdcc-8eef1e884b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.875247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516f001-e71c-4fc2-bdcc-8eef1e884b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.876036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516f001-e71c-4fc2-bdcc-8eef1e884b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:04.877658 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516f001-e71c-4fc2-bdcc-8eef1e884b60 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:04.892888 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 974/1933] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:04.893952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516f001-e71c-4fc2-bdcc-8eef1e884b60 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:04.906302 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516f001-e71c-4fc2-bdcc-8eef1e884b60 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:04.939507 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befaddab-935f-4225-95de-9e18be578462 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:04.940036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b35f54-c0e0-4617-8613-db9702e43974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:04.941183 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b35f54-c0e0-4617-8613-db9702e43974 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.942646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b35f54-c0e0-4617-8613-db9702e43974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.943036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b35f54-c0e0-4617-8613-db9702e43974 admin admin] PATH_INFO: `/v3/projects/dea701672dbd47a8917aab5ef7e8797f/users/c4e386f766e445288572cb61ba28f648/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.943672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304a083-d782-44f6-9cec-def5df9925e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:04.943815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304a083-d782-44f6-9cec-def5df9925e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:04.944071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304a083-d782-44f6-9cec-def5df9925e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:04.944481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304a083-d782-44f6-9cec-def5df9925e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:04.963627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304a083-d782-44f6-9cec-def5df9925e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:04.966384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304a083-d782-44f6-9cec-def5df9925e3 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:04.968030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b35f54-c0e0-4617-8613-db9702e43974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea701672dbd47a8917aab5ef7e8797f, user_id=c4e386f766e445288572cb61ba28f648, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:04.971575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b35f54-c0e0-4617-8613-db9702e43974 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:04.988490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 960/1934] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:04.989951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 975/1935] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:04 2022] PUT /identity/v3/projects/dea701672dbd47a8917aab5ef7e8797f/users/c4e386f766e445288572cb61ba28f648/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:04.993976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304a083-d782-44f6-9cec-def5df9925e3 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:05.007978 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304a083-d782-44f6-9cec-def5df9925e3 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:05.102740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5217f15-385b-464f-b03f-5594db6972ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:05.103406 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5217f15-385b-464f-b03f-5594db6972ca admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.103694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5217f15-385b-464f-b03f-5594db6972ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.106760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5217f15-385b-464f-b03f-5594db6972ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.107680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5217f15-385b-464f-b03f-5594db6972ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:05.111618 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5217f15-385b-464f-b03f-5594db6972ca admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:05.142951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 961/1936] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:05.148044 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b35f54-c0e0-4617-8613-db9702e43974 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:05.162110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b35f54-c0e0-4617-8613-db9702e43974 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:05.171768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f76907-1408-4868-9387-e9bef88c46b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:05.174417 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76907-1408-4868-9387-e9bef88c46b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.174787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76907-1408-4868-9387-e9bef88c46b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.175215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76907-1408-4868-9387-e9bef88c46b4 admin admin] PATH_INFO: `/v3/projects/dea701672dbd47a8917aab5ef7e8797f/users/c4e386f766e445288572cb61ba28f648/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.178125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f76907-1408-4868-9387-e9bef88c46b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea701672dbd47a8917aab5ef7e8797f, user_id=c4e386f766e445288572cb61ba28f648, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:05.185285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f76907-1408-4868-9387-e9bef88c46b4 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:05.215362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 976/1937] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:05 2022] PUT /identity/v3/projects/dea701672dbd47a8917aab5ef7e8797f/users/c4e386f766e445288572cb61ba28f648/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:05.218222 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf5be0-076f-400f-809b-1fb2437e212a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.218517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf5be0-076f-400f-809b-1fb2437e212a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.219756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf5be0-076f-400f-809b-1fb2437e212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.266419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a4cf5be0-076f-400f-809b-1fb2437e212a None None] MFA Rules not processed for user `c4e386f766e445288572cb61ba28f648`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:05.269008 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a4cf5be0-076f-400f-809b-1fb2437e212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:05.387240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f76907-1408-4868-9387-e9bef88c46b4 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:05.388975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-12f76907-1408-4868-9387-e9bef88c46b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:05.473310 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 962/1938] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:05.564989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f76907-1408-4868-9387-e9bef88c46b4 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:05.583553 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf5be0-076f-400f-809b-1fb2437e212a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:05.585118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a4cf5be0-076f-400f-809b-1fb2437e212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:05.586430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:05.588344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.588827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.591807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] PATH_INFO: `/v3/projects/f2360c6b0d01481ca45dd5c1f12d3352` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.593915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2360c6b0d01481ca45dd5c1f12d3352)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:05.596361 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:05.679181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2360c6b0d01481ca45dd5c1f12d3352', 'request_id': 'req-48b99cd2-8755-4353-82c2-0cecd5d408e0'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.684392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf5be0-076f-400f-809b-1fb2437e212a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:05.696484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2360c6b0d01481ca45dd5c1f12d3352', 'request_id': 'req-48b99cd2-8755-4353-82c2-0cecd5d408e0'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.706435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2360c6b0d01481ca45dd5c1f12d3352', 'request_id': 'req-48b99cd2-8755-4353-82c2-0cecd5d408e0'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.729399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] The token cache is being invalidate because project f2360c6b0d01481ca45dd5c1f12d3352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:05.729707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.731502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.736300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 977/1939] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:05 2022] DELETE /identity/v3/projects/f2360c6b0d01481ca45dd5c1f12d3352 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:05.736300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:05.736598 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:05.751398 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db545a-49c5-437c-bf81-9d94a600350d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:05.752243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db545a-49c5-437c-bf81-9d94a600350d service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.752624 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db545a-49c5-437c-bf81-9d94a600350d service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.753000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db545a-49c5-437c-bf81-9d94a600350d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.755182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-94db545a-49c5-437c-bf81-9d94a600350d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:05.829394 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b99cd2-8755-4353-82c2-0cecd5d408e0 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:05.831706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db545a-49c5-437c-bf81-9d94a600350d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:05.833564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db545a-49c5-437c-bf81-9d94a600350d service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:05.842066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57524a83-26fd-4d42-ad7c-1f5891021674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:05.843112 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524a83-26fd-4d42-ad7c-1f5891021674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.843497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524a83-26fd-4d42-ad7c-1f5891021674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.843877 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524a83-26fd-4d42-ad7c-1f5891021674 admin admin] PATH_INFO: `/v3/users/5886587e30094f1d8c150b9c85049472` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.845370 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57524a83-26fd-4d42-ad7c-1f5891021674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5886587e30094f1d8c150b9c85049472)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:05.847997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57524a83-26fd-4d42-ad7c-1f5891021674 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:05.850461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 963/1940] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:05.852001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db545a-49c5-437c-bf81-9d94a600350d service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:05.856277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-94db545a-49c5-437c-bf81-9d94a600350d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:05.877794 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db545a-49c5-437c-bf81-9d94a600350d service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:05.888747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:05.890777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.891590 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.892005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] PATH_INFO: `/v3/users/137cd44d5c004be7b714967f3064f018` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.894283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] RBAC: Authorizing `identity:delete_user(user_id=137cd44d5c004be7b714967f3064f018)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:05.898415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:05.909348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-57524a83-26fd-4d42-ad7c-1f5891021674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5886587e30094f1d8c150b9c85049472'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.910233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-57524a83-26fd-4d42-ad7c-1f5891021674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5886587e30094f1d8c150b9c85049472'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.911001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-57524a83-26fd-4d42-ad7c-1f5891021674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5886587e30094f1d8c150b9c85049472'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.927035 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-57524a83-26fd-4d42-ad7c-1f5891021674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5886587e30094f1d8c150b9c85049472'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.942425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-57524a83-26fd-4d42-ad7c-1f5891021674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5886587e30094f1d8c150b9c85049472'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.969045 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 978/1941] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:05 2022] DELETE /identity/v3/users/5886587e30094f1d8c150b9c85049472 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:05.973738 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485b77-2cee-42bc-86ac-eef0aad3ab0b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.974053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485b77-2cee-42bc-86ac-eef0aad3ab0b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.974357 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485b77-2cee-42bc-86ac-eef0aad3ab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.998122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '137cd44d5c004be7b714967f3064f018'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.998461 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-53485b77-2cee-42bc-86ac-eef0aad3ab0b None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:05.998786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '137cd44d5c004be7b714967f3064f018'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.999754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-53485b77-2cee-42bc-86ac-eef0aad3ab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:06.029173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '137cd44d5c004be7b714967f3064f018'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.045031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '137cd44d5c004be7b714967f3064f018'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.065977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '137cd44d5c004be7b714967f3064f018'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.074813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 964/1942] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:05 2022] DELETE /identity/v3/users/137cd44d5c004be7b714967f3064f018 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:06.164122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 979/1943] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:06.175329 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:06.177370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:06.285916 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50226d-5f60-42ab-8c0f-215c29d1abff admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:06.291519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245568c-9962-4a53-96bd-7a2909fcac8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:06.292486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245568c-9962-4a53-96bd-7a2909fcac8e service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.293570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245568c-9962-4a53-96bd-7a2909fcac8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.294583 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245568c-9962-4a53-96bd-7a2909fcac8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.410924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53485b77-2cee-42bc-86ac-eef0aad3ab0b None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:06.412369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-53485b77-2cee-42bc-86ac-eef0aad3ab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:06.413977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245568c-9962-4a53-96bd-7a2909fcac8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:06.415631 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245568c-9962-4a53-96bd-7a2909fcac8e service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:06.434920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53485b77-2cee-42bc-86ac-eef0aad3ab0b None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:06.444350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 965/1944] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:06.459383 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:06.460050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.460452 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.460824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] PATH_INFO: `/v3/users/e668cd69acbb45af8f390c34bc57b830` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.464227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e668cd69acbb45af8f390c34bc57b830)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:06.466747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:06.564093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e668cd69acbb45af8f390c34bc57b830'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.566133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e668cd69acbb45af8f390c34bc57b830'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.567306 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e668cd69acbb45af8f390c34bc57b830'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.592635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e668cd69acbb45af8f390c34bc57b830'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.612166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e668cd69acbb45af8f390c34bc57b830'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.642820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 980/1945] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:06 2022] DELETE /identity/v3/users/e668cd69acbb45af8f390c34bc57b830 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:06.648462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d94eb-4957-4830-956a-bdf78c49c981 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.648825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d94eb-4957-4830-956a-bdf78c49c981 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.649165 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d94eb-4957-4830-956a-bdf78c49c981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.699511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-843d94eb-4957-4830-956a-bdf78c49c981 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:06.700810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-843d94eb-4957-4830-956a-bdf78c49c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:06.851870 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 966/1946] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:06.863191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:06.865208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:06.950110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97440592-4374-48f3-8c3b-d14a1303f788 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:06.955197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a359ff-2909-415f-9dd4-0a2ea3de1996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:06.955930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a359ff-2909-415f-9dd4-0a2ea3de1996 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.956232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a359ff-2909-415f-9dd4-0a2ea3de1996 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.956540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a359ff-2909-415f-9dd4-0a2ea3de1996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.967043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a359ff-2909-415f-9dd4-0a2ea3de1996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:06.968473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a359ff-2909-415f-9dd4-0a2ea3de1996 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:06.995107 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 981/1947] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:07.092092 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d94eb-4957-4830-956a-bdf78c49c981 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:07.093605 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-843d94eb-4957-4830-956a-bdf78c49c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.109317 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d94eb-4957-4830-956a-bdf78c49c981 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:07.130591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:07.134039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:07.134556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:07.135050 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] PATH_INFO: `/v3/projects/cd90eee232a94c86a3d4458c6c4b275f` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:07.136578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd90eee232a94c86a3d4458c6c4b275f)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:07.139813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:07.244864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd90eee232a94c86a3d4458c6c4b275f', 'request_id': 'req-d17ff644-4e05-4581-b429-3185eb0676e3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.252215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd90eee232a94c86a3d4458c6c4b275f', 'request_id': 'req-d17ff644-4e05-4581-b429-3185eb0676e3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.259167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd90eee232a94c86a3d4458c6c4b275f', 'request_id': 'req-d17ff644-4e05-4581-b429-3185eb0676e3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.278371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] The token cache is being invalidate because project cd90eee232a94c86a3d4458c6c4b275f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:07.279690 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.280451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.285189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 967/1948] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:07 2022] DELETE /identity/v3/projects/cd90eee232a94c86a3d4458c6c4b275f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:07.287831 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272ec5-3712-45fd-9736-15f2875ae023 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:07.288133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272ec5-3712-45fd-9736-15f2875ae023 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:07.288417 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272ec5-3712-45fd-9736-15f2875ae023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:07.313017 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-a4272ec5-3712-45fd-9736-15f2875ae023 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:07.314284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a4272ec5-3712-45fd-9736-15f2875ae023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.364178 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:07.373156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.396006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 982/1949] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:07.405320 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536c064-8c59-4eb5-bf8b-88eb123f3f34 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:07.405711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536c064-8c59-4eb5-bf8b-88eb123f3f34 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:07.406046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536c064-8c59-4eb5-bf8b-88eb123f3f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:07.436082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2536c064-8c59-4eb5-bf8b-88eb123f3f34 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:07.437419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2536c064-8c59-4eb5-bf8b-88eb123f3f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.451597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 983/1950] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:07.451597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536c064-8c59-4eb5-bf8b-88eb123f3f34 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:07.452360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2536c064-8c59-4eb5-bf8b-88eb123f3f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.469441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536c064-8c59-4eb5-bf8b-88eb123f3f34 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:07.477759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:07.478626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:07.478985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:07.479851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] PATH_INFO: `/v3/projects/781525e7ecf84c7c8b14d99f1fbd3c9d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:07.481610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=781525e7ecf84c7c8b14d99f1fbd3c9d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:07.483581 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:07.488818 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ff644-4e05-4581-b429-3185eb0676e3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:07.494692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:07.496428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:07.496922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:07.497458 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] PATH_INFO: `/v3/projects/c0a15fac3d664e879e118b83dd18e351` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:07.499009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a15fac3d664e879e118b83dd18e351)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:07.501615 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:07.551984 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781525e7ecf84c7c8b14d99f1fbd3c9d', 'request_id': 'req-2dfce4b8-3d41-4d89-abf3-1705ff672392'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.565749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781525e7ecf84c7c8b14d99f1fbd3c9d', 'request_id': 'req-2dfce4b8-3d41-4d89-abf3-1705ff672392'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.572795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a15fac3d664e879e118b83dd18e351', 'request_id': 'req-11798c39-2daa-429d-b3b6-96a1b666c79b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.576273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781525e7ecf84c7c8b14d99f1fbd3c9d', 'request_id': 'req-2dfce4b8-3d41-4d89-abf3-1705ff672392'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.580429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a15fac3d664e879e118b83dd18e351', 'request_id': 'req-11798c39-2daa-429d-b3b6-96a1b666c79b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.594502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a15fac3d664e879e118b83dd18e351', 'request_id': 'req-11798c39-2daa-429d-b3b6-96a1b666c79b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.596140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] The token cache is being invalidate because project 781525e7ecf84c7c8b14d99f1fbd3c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:07.598146 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.599190 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.601337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 984/1951] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:07 2022] DELETE /identity/v3/projects/781525e7ecf84c7c8b14d99f1fbd3c9d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:07.604942 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:07.607107 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.619884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] The token cache is being invalidate because project c0a15fac3d664e879e118b83dd18e351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:07.620194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.621528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.626496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 968/1952] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:07 2022] DELETE /identity/v3/projects/c0a15fac3d664e879e118b83dd18e351 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:07.626496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:07.627919 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.699292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfce4b8-3d41-4d89-abf3-1705ff672392 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:07.756004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11798c39-2daa-429d-b3b6-96a1b666c79b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:07.762805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:07.766563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:07.766980 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:07.767372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] PATH_INFO: `/v3/users/fc2821005e52490faad9ead5b9767276` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:07.768897 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2821005e52490faad9ead5b9767276)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:07.771549 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:07.774348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ca14-8ec6-4a17-9a68-c88ea2050f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:07.775049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ca14-8ec6-4a17-9a68-c88ea2050f50 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:07.775339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ca14-8ec6-4a17-9a68-c88ea2050f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:07.775619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ca14-8ec6-4a17-9a68-c88ea2050f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:07.776412 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62ca14-8ec6-4a17-9a68-c88ea2050f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:07.776727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62ca14-8ec6-4a17-9a68-c88ea2050f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:07.778850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62ca14-8ec6-4a17-9a68-c88ea2050f50 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:07.794229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 985/1953] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:07.795114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ca14-8ec6-4a17-9a68-c88ea2050f50 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:07.799934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-9f62ca14-8ec6-4a17-9a68-c88ea2050f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.816760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ca14-8ec6-4a17-9a68-c88ea2050f50 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:07.823562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:07.824540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:07.825444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:07.825725 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] PATH_INFO: `/v3/users/1f239a75daef49958d4616d16e5f590e` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:07.826979 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f239a75daef49958d4616d16e5f590e)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:07.828522 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2821005e52490faad9ead5b9767276'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.828934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:07.829315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2821005e52490faad9ead5b9767276'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.846179 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2821005e52490faad9ead5b9767276'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.856465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2821005e52490faad9ead5b9767276'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.865061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2821005e52490faad9ead5b9767276'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.872548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 969/1954] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:07 2022] DELETE /identity/v3/users/fc2821005e52490faad9ead5b9767276 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:07.873818 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:07.875185 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.888344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f239a75daef49958d4616d16e5f590e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.889192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f239a75daef49958d4616d16e5f590e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.890104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f239a75daef49958d4616d16e5f590e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.902928 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f239a75daef49958d4616d16e5f590e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.911511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f239a75daef49958d4616d16e5f590e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:07.927096 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 986/1955] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:07 2022] DELETE /identity/v3/users/1f239a75daef49958d4616d16e5f590e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:07.930946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:07.932583 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.943888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b9398-60d2-487d-876b-44babd187ca5 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.028927 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48baf9a-1f3c-4d75-94a0-80ffd114b09a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.029507 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48baf9a-1f3c-4d75-94a0-80ffd114b09a service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.029786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48baf9a-1f3c-4d75-94a0-80ffd114b09a service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.030060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48baf9a-1f3c-4d75-94a0-80ffd114b09a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.031919 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a48baf9a-1f3c-4d75-94a0-80ffd114b09a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.044059 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf91661-56a8-429f-8ad3-fc7edd7c223f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.049336 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aabd2-7bd0-4180-9451-c79d64b1d30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.050113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aabd2-7bd0-4180-9451-c79d64b1d30a admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.050468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aabd2-7bd0-4180-9451-c79d64b1d30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.050881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aabd2-7bd0-4180-9451-c79d64b1d30a admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.051636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85aabd2-7bd0-4180-9451-c79d64b1d30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.053855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85aabd2-7bd0-4180-9451-c79d64b1d30a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.104641 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 987/1956] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:07 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:08.113662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aabd2-7bd0-4180-9451-c79d64b1d30a admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.129108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48baf9a-1f3c-4d75-94a0-80ffd114b09a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.132248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48baf9a-1f3c-4d75-94a0-80ffd114b09a service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.161622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 970/1957] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:08.191351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aabd2-7bd0-4180-9451-c79d64b1d30a admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.197199 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389dee7-b494-4c96-a7a8-94b4e3aac8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.197875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389dee7-b494-4c96-a7a8-94b4e3aac8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.198163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389dee7-b494-4c96-a7a8-94b4e3aac8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.198448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389dee7-b494-4c96-a7a8-94b4e3aac8b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.199713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389dee7-b494-4c96-a7a8-94b4e3aac8b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.201628 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389dee7-b494-4c96-a7a8-94b4e3aac8b5 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.232455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 988/1958] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:08 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:08.233879 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48baf9a-1f3c-4d75-94a0-80ffd114b09a service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.246109 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48baf9a-1f3c-4d75-94a0-80ffd114b09a service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.251823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ff8f-1a2f-4bdd-b3cb-e68f6cc0d307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.252541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ff8f-1a2f-4bdd-b3cb-e68f6cc0d307 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.253724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ff8f-1a2f-4bdd-b3cb-e68f6cc0d307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.253724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ff8f-1a2f-4bdd-b3cb-e68f6cc0d307 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.254061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973ff8f-1a2f-4bdd-b3cb-e68f6cc0d307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.255408 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973ff8f-1a2f-4bdd-b3cb-e68f6cc0d307 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.271170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 971/1959] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:08.272497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389dee7-b494-4c96-a7a8-94b4e3aac8b5 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.283616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389dee7-b494-4c96-a7a8-94b4e3aac8b5 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.288771 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac67cd-14cb-40f7-96a3-9797ccb59644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.289460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac67cd-14cb-40f7-96a3-9797ccb59644 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.289826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac67cd-14cb-40f7-96a3-9797ccb59644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.290178 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac67cd-14cb-40f7-96a3-9797ccb59644 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.291015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac67cd-14cb-40f7-96a3-9797ccb59644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.293162 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac67cd-14cb-40f7-96a3-9797ccb59644 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.304258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 989/1960] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:08.308514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ff8f-1a2f-4bdd-b3cb-e68f6cc0d307 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.319052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ff8f-1a2f-4bdd-b3cb-e68f6cc0d307 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.325435 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efbf5e-c87f-4794-91df-81ce2d76de35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.326395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efbf5e-c87f-4794-91df-81ce2d76de35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.326887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efbf5e-c87f-4794-91df-81ce2d76de35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.327441 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efbf5e-c87f-4794-91df-81ce2d76de35 admin admin] PATH_INFO: `/v3/projects/5ca0c768a6b64e159d937b8f4f5c6db4/users/a7643971b01a426e948fc622e3323e4a/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.346949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efbf5e-c87f-4794-91df-81ce2d76de35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca0c768a6b64e159d937b8f4f5c6db4, user_id=a7643971b01a426e948fc622e3323e4a, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.349724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efbf5e-c87f-4794-91df-81ce2d76de35 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.365696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 972/1961] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:08 2022] PUT /identity/v3/projects/5ca0c768a6b64e159d937b8f4f5c6db4/users/a7643971b01a426e948fc622e3323e4a/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:08.377431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be33e7d-0ec4-4a41-b8b9-16feb31da93d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.377727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be33e7d-0ec4-4a41-b8b9-16feb31da93d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.377835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efbf5e-c87f-4794-91df-81ce2d76de35 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.378007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be33e7d-0ec4-4a41-b8b9-16feb31da93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.379675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-68efbf5e-c87f-4794-91df-81ce2d76de35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.409670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-0be33e7d-0ec4-4a41-b8b9-16feb31da93d None None] MFA Rules not processed for user `a7643971b01a426e948fc622e3323e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:08.410617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0be33e7d-0ec4-4a41-b8b9-16feb31da93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.471574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efbf5e-c87f-4794-91df-81ce2d76de35 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.476682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.477586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.477880 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.478169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] PATH_INFO: `/v3/projects/4e1f0e0f94814a23932e0d8296245149` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.479377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1f0e0f94814a23932e0d8296245149)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.481376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.488847 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 990/1962] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:08.491950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be33e7d-0ec4-4a41-b8b9-16feb31da93d None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.493317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0be33e7d-0ec4-4a41-b8b9-16feb31da93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.507564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be33e7d-0ec4-4a41-b8b9-16feb31da93d None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.513924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.514789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.515154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.515445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] PATH_INFO: `/v3/projects/3b153ec0ac4143159066d14741a5dfaa` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.516712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b153ec0ac4143159066d14741a5dfaa)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.518721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.539506 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1f0e0f94814a23932e0d8296245149', 'request_id': 'req-80395655-c7ff-4b6a-9a99-085fd9dd10f1'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:08.547397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1f0e0f94814a23932e0d8296245149', 'request_id': 'req-80395655-c7ff-4b6a-9a99-085fd9dd10f1'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:08.558076 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1f0e0f94814a23932e0d8296245149', 'request_id': 'req-80395655-c7ff-4b6a-9a99-085fd9dd10f1'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:08.574668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b153ec0ac4143159066d14741a5dfaa', 'request_id': 'req-b29ef7be-12ed-48f3-8003-005662729b68'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:08.575662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] The token cache is being invalidate because project 4e1f0e0f94814a23932e0d8296245149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:08.575946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:08.576666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:08.578503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 973/1963] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:08 2022] DELETE /identity/v3/projects/4e1f0e0f94814a23932e0d8296245149 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:08.579291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.580590 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.584375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b153ec0ac4143159066d14741a5dfaa', 'request_id': 'req-b29ef7be-12ed-48f3-8003-005662729b68'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:08.591377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b153ec0ac4143159066d14741a5dfaa', 'request_id': 'req-b29ef7be-12ed-48f3-8003-005662729b68'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:08.606677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] The token cache is being invalidate because project 3b153ec0ac4143159066d14741a5dfaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:08.607036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:08.607813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b29ef7be-12ed-48f3-8003-005662729b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:08.609672 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 991/1964] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:08 2022] DELETE /identity/v3/projects/3b153ec0ac4143159066d14741a5dfaa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:08.613241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52661814-16c2-4cdd-bbcb-298c36ae81f4 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.613241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52661814-16c2-4cdd-bbcb-298c36ae81f4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.613241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52661814-16c2-4cdd-bbcb-298c36ae81f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.632360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-52661814-16c2-4cdd-bbcb-298c36ae81f4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:08.633856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-52661814-16c2-4cdd-bbcb-298c36ae81f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.651626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80395655-c7ff-4b6a-9a99-085fd9dd10f1 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.708887 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 992/1965] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:08.710232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ba3b-f6bf-4105-93f8-67bc0f550547 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.710528 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ba3b-f6bf-4105-93f8-67bc0f550547 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.710809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ba3b-f6bf-4105-93f8-67bc0f550547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.718855 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7a067-3d05-4ee7-859c-68a00b65f758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.719569 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7a067-3d05-4ee7-859c-68a00b65f758 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.719850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7a067-3d05-4ee7-859c-68a00b65f758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.720123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7a067-3d05-4ee7-859c-68a00b65f758 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.720815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7a067-3d05-4ee7-859c-68a00b65f758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.722835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7a067-3d05-4ee7-859c-68a00b65f758 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.732069 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-a2b6ba3b-f6bf-4105-93f8-67bc0f550547 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:08.743574 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a2b6ba3b-f6bf-4105-93f8-67bc0f550547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.753865 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 993/1966] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:08.755334 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e7f53-1572-40f3-96ca-74136f831283 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.755925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e7f53-1572-40f3-96ca-74136f831283 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.757548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 974/1967] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:08 2022] POST /identity/v3/projects => generated 389 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:08.759314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e7f53-1572-40f3-96ca-74136f831283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.764432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7a067-3d05-4ee7-859c-68a00b65f758 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.767355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-77c7a067-3d05-4ee7-859c-68a00b65f758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.787974 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-954e7f53-1572-40f3-96ca-74136f831283 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:08.789265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-954e7f53-1572-40f3-96ca-74136f831283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.831775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7a067-3d05-4ee7-859c-68a00b65f758 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.836723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ec971-f3f7-4329-8f58-0cf40231ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.837418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ec971-f3f7-4329-8f58-0cf40231ce54 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.837699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ec971-f3f7-4329-8f58-0cf40231ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.837967 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ec971-f3f7-4329-8f58-0cf40231ce54 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.838650 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ec971-f3f7-4329-8f58-0cf40231ce54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.840662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ec971-f3f7-4329-8f58-0cf40231ce54 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.848981 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 994/1968] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:08.850437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d22bf-2744-48e6-bc14-49dcbdba56c2 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.850822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d22bf-2744-48e6-bc14-49dcbdba56c2 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.851247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d22bf-2744-48e6-bc14-49dcbdba56c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.861512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 975/1969] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:08 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:08.862173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ec971-f3f7-4329-8f58-0cf40231ce54 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.863783 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7e8ec971-f3f7-4329-8f58-0cf40231ce54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.874461 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-569d22bf-2744-48e6-bc14-49dcbdba56c2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:08.875732 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-569d22bf-2744-48e6-bc14-49dcbdba56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.889013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 995/1970] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:08.889884 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d22bf-2744-48e6-bc14-49dcbdba56c2 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.900521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d22bf-2744-48e6-bc14-49dcbdba56c2 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.906147 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c3006-5a76-4ab6-a28e-1c8757348157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.906876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c3006-5a76-4ab6-a28e-1c8757348157 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.907663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c3006-5a76-4ab6-a28e-1c8757348157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.908009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c3006-5a76-4ab6-a28e-1c8757348157 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.908965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c3006-5a76-4ab6-a28e-1c8757348157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:08.909351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c3006-5a76-4ab6-a28e-1c8757348157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.911046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c3006-5a76-4ab6-a28e-1c8757348157 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.923410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 996/1971] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:08.924648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ec971-f3f7-4329-8f58-0cf40231ce54 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.927728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c3006-5a76-4ab6-a28e-1c8757348157 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.928559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2959-34ea-40fc-b2c0-3f0bd18fe8e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.929363 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2959-34ea-40fc-b2c0-3f0bd18fe8e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.929647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2959-34ea-40fc-b2c0-3f0bd18fe8e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.929916 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2959-34ea-40fc-b2c0-3f0bd18fe8e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.931793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-870c2959-34ea-40fc-b2c0-3f0bd18fe8e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:08.940582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c3006-5a76-4ab6-a28e-1c8757348157 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.945553 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d374f4-b643-4d81-9027-405e85f27e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.946207 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d374f4-b643-4d81-9027-405e85f27e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.946486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d374f4-b643-4d81-9027-405e85f27e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.946762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d374f4-b643-4d81-9027-405e85f27e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.947529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d374f4-b643-4d81-9027-405e85f27e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.949133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d374f4-b643-4d81-9027-405e85f27e7e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.959666 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 997/1972] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:08.960721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d374f4-b643-4d81-9027-405e85f27e7e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:08.971250 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d374f4-b643-4d81-9027-405e85f27e7e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:08.976073 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e897f-2c97-4b86-9d61-e866fc1ccc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:08.976695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e897f-2c97-4b86-9d61-e866fc1ccc26 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:08.976972 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e897f-2c97-4b86-9d61-e866fc1ccc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:08.977243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e897f-2c97-4b86-9d61-e866fc1ccc26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:08.977939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e897f-2c97-4b86-9d61-e866fc1ccc26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:08.978239 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e897f-2c97-4b86-9d61-e866fc1ccc26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:08.979860 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e897f-2c97-4b86-9d61-e866fc1ccc26 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:08.991815 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 998/1973] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:08.992826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e897f-2c97-4b86-9d61-e866fc1ccc26 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.002555 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c2959-34ea-40fc-b2c0-3f0bd18fe8e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.002768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e897f-2c97-4b86-9d61-e866fc1ccc26 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.004046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c2959-34ea-40fc-b2c0-3f0bd18fe8e8 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.007799 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc194af-0dec-4e86-85b6-de0678839894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.008424 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc194af-0dec-4e86-85b6-de0678839894 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.008703 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc194af-0dec-4e86-85b6-de0678839894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.008985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc194af-0dec-4e86-85b6-de0678839894 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.009655 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc194af-0dec-4e86-85b6-de0678839894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.011584 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc194af-0dec-4e86-85b6-de0678839894 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.013643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 976/1974] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:09.014399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2959-34ea-40fc-b2c0-3f0bd18fe8e8 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.024349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2959-34ea-40fc-b2c0-3f0bd18fe8e8 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.028735 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416766e4-3360-4b8a-ad5a-930c844a7509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.029592 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416766e4-3360-4b8a-ad5a-930c844a7509 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.029864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416766e4-3360-4b8a-ad5a-930c844a7509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.030395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416766e4-3360-4b8a-ad5a-930c844a7509 admin admin] PATH_INFO: `/v3/projects/c5a5497c33be426fba3ddc27a96a7290/users/906263c1c584443a9605a32d658afb59/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.046148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 999/1975] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:08 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:09.046148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc194af-0dec-4e86-85b6-de0678839894 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.051954 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416766e4-3360-4b8a-ad5a-930c844a7509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a5497c33be426fba3ddc27a96a7290, user_id=906263c1c584443a9605a32d658afb59, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.055035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416766e4-3360-4b8a-ad5a-930c844a7509 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.071391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 977/1976] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:09 2022] PUT /identity/v3/projects/c5a5497c33be426fba3ddc27a96a7290/users/906263c1c584443a9605a32d658afb59/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:09.072095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416766e4-3360-4b8a-ad5a-930c844a7509 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.135942 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc194af-0dec-4e86-85b6-de0678839894 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.139222 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416766e4-3360-4b8a-ad5a-930c844a7509 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.140845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a99f14-68cc-4ec9-b09b-6629c4514809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.141495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99f14-68cc-4ec9-b09b-6629c4514809 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.141782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99f14-68cc-4ec9-b09b-6629c4514809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.142057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99f14-68cc-4ec9-b09b-6629c4514809 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.142747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a99f14-68cc-4ec9-b09b-6629c4514809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.143741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef7d7-7a42-4c87-8f5a-2c5dd19609bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.144393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef7d7-7a42-4c87-8f5a-2c5dd19609bb admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.144667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef7d7-7a42-4c87-8f5a-2c5dd19609bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.144759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a99f14-68cc-4ec9-b09b-6629c4514809 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.144934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef7d7-7a42-4c87-8f5a-2c5dd19609bb admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.145607 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cef7d7-7a42-4c87-8f5a-2c5dd19609bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.147517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cef7d7-7a42-4c87-8f5a-2c5dd19609bb admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.171454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 978/1977] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:09.172689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1000/1978] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:09.175698 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef7d7-7a42-4c87-8f5a-2c5dd19609bb admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.176153 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a99f14-68cc-4ec9-b09b-6629c4514809 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.185585 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef7d7-7a42-4c87-8f5a-2c5dd19609bb admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.240204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a99f14-68cc-4ec9-b09b-6629c4514809 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.245339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb7193-33d8-40f5-ace8-5a30468aa113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.246616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7193-33d8-40f5-ace8-5a30468aa113 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.247108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7193-33d8-40f5-ace8-5a30468aa113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.247343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7193-33d8-40f5-ace8-5a30468aa113 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.247745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d477af-a899-48d4-b286-b297d013489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.248208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb7193-33d8-40f5-ace8-5a30468aa113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.248559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d477af-a899-48d4-b286-b297d013489b admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.248848 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d477af-a899-48d4-b286-b297d013489b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.249129 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d477af-a899-48d4-b286-b297d013489b admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.249649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb7193-33d8-40f5-ace8-5a30468aa113 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.249897 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d477af-a899-48d4-b286-b297d013489b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.251591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d477af-a899-48d4-b286-b297d013489b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.263110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1001/1979] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:09.263110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb7193-33d8-40f5-ace8-5a30468aa113 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.263489 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 979/1980] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:09.264310 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d477af-a899-48d4-b286-b297d013489b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.275008 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb7193-33d8-40f5-ace8-5a30468aa113 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.275183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d477af-a899-48d4-b286-b297d013489b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.280396 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4c7a8-16ac-4639-9619-35c7c0a92f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.280849 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f1955-cb08-4352-9ac2-3edb768d7159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.281120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4c7a8-16ac-4639-9619-35c7c0a92f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.281326 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4c7a8-16ac-4639-9619-35c7c0a92f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.281505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1955-cb08-4352-9ac2-3edb768d7159 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.281604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4c7a8-16ac-4639-9619-35c7c0a92f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.281792 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1955-cb08-4352-9ac2-3edb768d7159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.282067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1955-cb08-4352-9ac2-3edb768d7159 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.282294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4c7a8-16ac-4639-9619-35c7c0a92f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.282790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f1955-cb08-4352-9ac2-3edb768d7159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.284042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4c7a8-16ac-4639-9619-35c7c0a92f0b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.284719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f1955-cb08-4352-9ac2-3edb768d7159 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.295442 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 980/1981] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:09.296339 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4c7a8-16ac-4639-9619-35c7c0a92f0b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.307000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4c7a8-16ac-4639-9619-35c7c0a92f0b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.310966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1002/1982] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:09.312019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f1955-cb08-4352-9ac2-3edb768d7159 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.314603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f80f64-c56a-4854-b498-ed86e979906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.315600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f80f64-c56a-4854-b498-ed86e979906a admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.315950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f80f64-c56a-4854-b498-ed86e979906a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.316318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f80f64-c56a-4854-b498-ed86e979906a admin admin] PATH_INFO: `/v3/projects/c5a5497c33be426fba3ddc27a96a7290/users/906263c1c584443a9605a32d658afb59/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.318419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f80f64-c56a-4854-b498-ed86e979906a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a5497c33be426fba3ddc27a96a7290, user_id=906263c1c584443a9605a32d658afb59, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.321238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f80f64-c56a-4854-b498-ed86e979906a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.323809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f1955-cb08-4352-9ac2-3edb768d7159 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.329723 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee6a62-a551-4a58-91ec-c17257522478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.330646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee6a62-a551-4a58-91ec-c17257522478 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.330964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee6a62-a551-4a58-91ec-c17257522478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.331273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee6a62-a551-4a58-91ec-c17257522478 admin admin] PATH_INFO: `/v3/projects/01638350ace34faca06a0f57d40122ba/users/7a03371372a146edb9ee374e72fa53f9/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.343408 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 981/1983] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:09 2022] PUT /identity/v3/projects/c5a5497c33be426fba3ddc27a96a7290/users/906263c1c584443a9605a32d658afb59/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:09.343408 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f80f64-c56a-4854-b498-ed86e979906a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.350703 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee6a62-a551-4a58-91ec-c17257522478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01638350ace34faca06a0f57d40122ba, user_id=7a03371372a146edb9ee374e72fa53f9, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.353803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee6a62-a551-4a58-91ec-c17257522478 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.374631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1003/1984] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:09 2022] PUT /identity/v3/projects/01638350ace34faca06a0f57d40122ba/users/7a03371372a146edb9ee374e72fa53f9/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:09.384824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198ccc0-7ae8-4dc1-a84a-d96328b5da4f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.385108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198ccc0-7ae8-4dc1-a84a-d96328b5da4f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.385381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198ccc0-7ae8-4dc1-a84a-d96328b5da4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.407813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f80f64-c56a-4854-b498-ed86e979906a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.411469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-3198ccc0-7ae8-4dc1-a84a-d96328b5da4f None None] MFA Rules not processed for user `906263c1c584443a9605a32d658afb59`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:09.412767 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3198ccc0-7ae8-4dc1-a84a-d96328b5da4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:09.464211 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d772a-4b31-4cd4-b1e4-9894a075dfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.464908 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d772a-4b31-4cd4-b1e4-9894a075dfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.465189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d772a-4b31-4cd4-b1e4-9894a075dfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.465462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d772a-4b31-4cd4-b1e4-9894a075dfc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.466186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d772a-4b31-4cd4-b1e4-9894a075dfc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.467827 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d772a-4b31-4cd4-b1e4-9894a075dfc5 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.477459 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 982/1985] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:09.478717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e253f-0747-4475-be4e-770572895c72 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.479039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e253f-0747-4475-be4e-770572895c72 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.479316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e253f-0747-4475-be4e-770572895c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.482571 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1004/1986] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:09.483570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198ccc0-7ae8-4dc1-a84a-d96328b5da4f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.496755 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198ccc0-7ae8-4dc1-a84a-d96328b5da4f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.502329 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6fc68-b296-49eb-a391-9f08dd22db38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.503127 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6fc68-b296-49eb-a391-9f08dd22db38 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.503443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6fc68-b296-49eb-a391-9f08dd22db38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.503722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6fc68-b296-49eb-a391-9f08dd22db38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.504511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6fc68-b296-49eb-a391-9f08dd22db38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.506416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6fc68-b296-49eb-a391-9f08dd22db38 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.513929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ee4e253f-0747-4475-be4e-770572895c72 None None] MFA Rules not processed for user `7a03371372a146edb9ee374e72fa53f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:09.515346 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ee4e253f-0747-4475-be4e-770572895c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:09.517718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1005/1987] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:09.518520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6fc68-b296-49eb-a391-9f08dd22db38 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.569950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6fc68-b296-49eb-a391-9f08dd22db38 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.573636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec0ab2-0dee-46b7-a143-822e22308585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.574879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0ab2-0dee-46b7-a143-822e22308585 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.575175 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0ab2-0dee-46b7-a143-822e22308585 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.575446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0ab2-0dee-46b7-a143-822e22308585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.579847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 983/1988] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:09.580669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e253f-0747-4475-be4e-770572895c72 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.585138 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec0ab2-0dee-46b7-a143-822e22308585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.586552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec0ab2-0dee-46b7-a143-822e22308585 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.593302 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e253f-0747-4475-be4e-770572895c72 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.596712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1006/1989] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:09.597534 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec0ab2-0dee-46b7-a143-822e22308585 service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.598599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bac0ba-d6dc-49b3-a613-d411ed8af38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.599504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bac0ba-d6dc-49b3-a613-d411ed8af38b admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.599785 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bac0ba-d6dc-49b3-a613-d411ed8af38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.600060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bac0ba-d6dc-49b3-a613-d411ed8af38b admin admin] PATH_INFO: `/v3/projects/2b0ae28929a14a62889b2d302419d2f2/users/dc527be4c7454f768a57720bac6878ec/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.607543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec0ab2-0dee-46b7-a143-822e22308585 service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.612351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a408cf-8948-4f6c-a0f5-6a6b9b7372a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.612982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a408cf-8948-4f6c-a0f5-6a6b9b7372a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.613348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a408cf-8948-4f6c-a0f5-6a6b9b7372a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.613533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a408cf-8948-4f6c-a0f5-6a6b9b7372a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.614374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a408cf-8948-4f6c-a0f5-6a6b9b7372a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.615372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bac0ba-d6dc-49b3-a613-d411ed8af38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0ae28929a14a62889b2d302419d2f2, user_id=dc527be4c7454f768a57720bac6878ec, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.616284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a408cf-8948-4f6c-a0f5-6a6b9b7372a2 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.618047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bac0ba-d6dc-49b3-a613-d411ed8af38b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.633141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 984/1990] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:09 2022] PUT /identity/v3/projects/2b0ae28929a14a62889b2d302419d2f2/users/dc527be4c7454f768a57720bac6878ec/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:09.647293 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdac1a-5a6c-4e00-b5ed-3a2de5b1df5b None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.647581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdac1a-5a6c-4e00-b5ed-3a2de5b1df5b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.647851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdac1a-5a6c-4e00-b5ed-3a2de5b1df5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.649301 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1007/1991] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:09.652934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a408cf-8948-4f6c-a0f5-6a6b9b7372a2 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.677906 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a4fdac1a-5a6c-4e00-b5ed-3a2de5b1df5b None None] MFA Rules not processed for user `dc527be4c7454f768a57720bac6878ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:09.678970 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a4fdac1a-5a6c-4e00-b5ed-3a2de5b1df5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:09.722230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a408cf-8948-4f6c-a0f5-6a6b9b7372a2 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.729878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77acf-4739-48b2-a61e-fdd5e901871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.729878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77acf-4739-48b2-a61e-fdd5e901871e admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.729878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77acf-4739-48b2-a61e-fdd5e901871e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.729878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77acf-4739-48b2-a61e-fdd5e901871e admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.730803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a77acf-4739-48b2-a61e-fdd5e901871e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.731935 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a77acf-4739-48b2-a61e-fdd5e901871e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.748727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 985/1992] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:09.749577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdac1a-5a6c-4e00-b5ed-3a2de5b1df5b None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.758060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1008/1993] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:09.758060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77acf-4739-48b2-a61e-fdd5e901871e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.759935 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdac1a-5a6c-4e00-b5ed-3a2de5b1df5b None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.764544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.765387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.765664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.765937 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] PATH_INFO: `/v3/users/a7643971b01a426e948fc622e3323e4a` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.766408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77acf-4739-48b2-a61e-fdd5e901871e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.767217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7643971b01a426e948fc622e3323e4a)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.769195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.771311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60aba1-b65d-49e6-9dd7-b8d8a9e095b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.772015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60aba1-b65d-49e6-9dd7-b8d8a9e095b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.772368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60aba1-b65d-49e6-9dd7-b8d8a9e095b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.772654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60aba1-b65d-49e6-9dd7-b8d8a9e095b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.773366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60aba1-b65d-49e6-9dd7-b8d8a9e095b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.775275 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60aba1-b65d-49e6-9dd7-b8d8a9e095b0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.804224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1009/1994] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:09.805622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60aba1-b65d-49e6-9dd7-b8d8a9e095b0 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.818309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7643971b01a426e948fc622e3323e4a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:09.819306 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7643971b01a426e948fc622e3323e4a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:09.832186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7643971b01a426e948fc622e3323e4a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:09.839853 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7643971b01a426e948fc622e3323e4a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:09.851350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7643971b01a426e948fc622e3323e4a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:09.853340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 986/1995] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:09 2022] DELETE /identity/v3/users/a7643971b01a426e948fc622e3323e4a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:09.854190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.856073 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:09.874671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60aba1-b65d-49e6-9dd7-b8d8a9e095b0 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.917269 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d658089-b288-4cda-9e31-b9abb7650bb5 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.922363 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f9aad-ad5a-4ed2-9c09-28b6f7fc1c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.923056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f9aad-ad5a-4ed2-9c09-28b6f7fc1c2c admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.923330 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f9aad-ad5a-4ed2-9c09-28b6f7fc1c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.923599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f9aad-ad5a-4ed2-9c09-28b6f7fc1c2c admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.924272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f9aad-ad5a-4ed2-9c09-28b6f7fc1c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.926163 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f9aad-ad5a-4ed2-9c09-28b6f7fc1c2c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.930312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d473c07-84d5-4216-bfd6-946cf4132cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.931137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d473c07-84d5-4216-bfd6-946cf4132cdd admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.931445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d473c07-84d5-4216-bfd6-946cf4132cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.931686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d473c07-84d5-4216-bfd6-946cf4132cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.932409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d473c07-84d5-4216-bfd6-946cf4132cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.934566 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d473c07-84d5-4216-bfd6-946cf4132cdd admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.944645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1010/1996] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:09.946062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c327d3f-aedb-4b77-95ce-9e931aaa9480 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.946459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c327d3f-aedb-4b77-95ce-9e931aaa9480 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.946841 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c327d3f-aedb-4b77-95ce-9e931aaa9480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.947044 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 987/1997] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:09.951384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f9aad-ad5a-4ed2-9c09-28b6f7fc1c2c admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.955159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-891f9aad-ad5a-4ed2-9c09-28b6f7fc1c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:09.966370 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-4c327d3f-aedb-4b77-95ce-9e931aaa9480 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:09.967153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f9aad-ad5a-4ed2-9c09-28b6f7fc1c2c admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.967593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4c327d3f-aedb-4b77-95ce-9e931aaa9480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:09.971910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4af569-be90-4fbd-81ed-d054158b25b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.972785 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4af569-be90-4fbd-81ed-d054158b25b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.973063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4af569-be90-4fbd-81ed-d054158b25b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.973340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4af569-be90-4fbd-81ed-d054158b25b2 admin admin] PATH_INFO: `/v3/projects/b66ce6dce90d43ad97e3ddf8733b3d42/users/e2fb866e69fa4b3ebdbbbdaa044290ad/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.976136 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1011/1998] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:09.976997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c327d3f-aedb-4b77-95ce-9e931aaa9480 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.988169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c327d3f-aedb-4b77-95ce-9e931aaa9480 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.989300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4af569-be90-4fbd-81ed-d054158b25b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66ce6dce90d43ad97e3ddf8733b3d42, user_id=e2fb866e69fa4b3ebdbbbdaa044290ad, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.992444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4af569-be90-4fbd-81ed-d054158b25b2 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.992807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f24546-e777-43cb-9665-9e1fea2f9493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.993469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f24546-e777-43cb-9665-9e1fea2f9493 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.993783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f24546-e777-43cb-9665-9e1fea2f9493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.994118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f24546-e777-43cb-9665-9e1fea2f9493 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.995019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f24546-e777-43cb-9665-9e1fea2f9493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.997202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f24546-e777-43cb-9665-9e1fea2f9493 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.015280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1012/1999] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:10.015280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f24546-e777-43cb-9665-9e1fea2f9493 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.015280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c7f24546-e777-43cb-9665-9e1fea2f9493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.015587 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 988/2000] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:09 2022] PUT /identity/v3/projects/b66ce6dce90d43ad97e3ddf8733b3d42/users/e2fb866e69fa4b3ebdbbbdaa044290ad/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:10.018977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4af569-be90-4fbd-81ed-d054158b25b2 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.071951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f24546-e777-43cb-9665-9e1fea2f9493 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.078118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4af569-be90-4fbd-81ed-d054158b25b2 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.088521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e08fa-d7a7-4f25-a14d-74b9303e29ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.089268 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e08fa-d7a7-4f25-a14d-74b9303e29ee admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.090166 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e08fa-d7a7-4f25-a14d-74b9303e29ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.090490 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e08fa-d7a7-4f25-a14d-74b9303e29ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.091202 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e08fa-d7a7-4f25-a14d-74b9303e29ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.092840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e08fa-d7a7-4f25-a14d-74b9303e29ee admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.103205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 989/2001] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:10.103965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e08fa-d7a7-4f25-a14d-74b9303e29ee admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.114195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e08fa-d7a7-4f25-a14d-74b9303e29ee admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.118784 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd03cb-2507-45a6-8bf6-9ca3ff0edece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.119849 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd03cb-2507-45a6-8bf6-9ca3ff0edece admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.120128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd03cb-2507-45a6-8bf6-9ca3ff0edece admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.120402 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd03cb-2507-45a6-8bf6-9ca3ff0edece admin admin] PATH_INFO: `/v3/projects/a6baf4aa0d22420cb97e0e340fa24621/users/2ca52e6437c74eab99f5c020087f234b/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.123741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47065cdd-3da4-44fb-b52c-be308e2bb389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.124507 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47065cdd-3da4-44fb-b52c-be308e2bb389 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.124796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47065cdd-3da4-44fb-b52c-be308e2bb389 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.125070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47065cdd-3da4-44fb-b52c-be308e2bb389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.135216 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47065cdd-3da4-44fb-b52c-be308e2bb389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.135575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd03cb-2507-45a6-8bf6-9ca3ff0edece admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6baf4aa0d22420cb97e0e340fa24621, user_id=2ca52e6437c74eab99f5c020087f234b, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.136687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47065cdd-3da4-44fb-b52c-be308e2bb389 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.138294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd03cb-2507-45a6-8bf6-9ca3ff0edece admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.146769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1013/2002] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:10.147582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47065cdd-3da4-44fb-b52c-be308e2bb389 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.154418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 990/2003] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:10 2022] PUT /identity/v3/projects/a6baf4aa0d22420cb97e0e340fa24621/users/2ca52e6437c74eab99f5c020087f234b/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:10.158249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd03cb-2507-45a6-8bf6-9ca3ff0edece admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.160026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47065cdd-3da4-44fb-b52c-be308e2bb389 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.222172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd03cb-2507-45a6-8bf6-9ca3ff0edece admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.228474 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38433a61-0ba5-4afc-afd0-1c2714ee3a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.229478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38433a61-0ba5-4afc-afd0-1c2714ee3a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.229879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bf1c6-1275-49a7-b7f3-5e42594d02d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.230799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38433a61-0ba5-4afc-afd0-1c2714ee3a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.231462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38433a61-0ba5-4afc-afd0-1c2714ee3a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.232247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38433a61-0ba5-4afc-afd0-1c2714ee3a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.232804 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf1c6-1275-49a7-b7f3-5e42594d02d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.233191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf1c6-1275-49a7-b7f3-5e42594d02d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.233557 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf1c6-1275-49a7-b7f3-5e42594d02d4 admin admin] PATH_INFO: `/v3/projects/b66ce6dce90d43ad97e3ddf8733b3d42/users/e2fb866e69fa4b3ebdbbbdaa044290ad/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.234309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38433a61-0ba5-4afc-afd0-1c2714ee3a3a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.236374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bf1c6-1275-49a7-b7f3-5e42594d02d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66ce6dce90d43ad97e3ddf8733b3d42, user_id=e2fb866e69fa4b3ebdbbbdaa044290ad, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.240121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bf1c6-1275-49a7-b7f3-5e42594d02d4 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.250712 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 991/2004] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:10.252457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38433a61-0ba5-4afc-afd0-1c2714ee3a3a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.254295 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1014/2005] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:10 2022] PUT /identity/v3/projects/b66ce6dce90d43ad97e3ddf8733b3d42/users/e2fb866e69fa4b3ebdbbbdaa044290ad/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:10.265099 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38433a61-0ba5-4afc-afd0-1c2714ee3a3a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.266256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e39b06-c084-4179-86ec-889bec7ed622 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.266667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e39b06-c084-4179-86ec-889bec7ed622 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.267103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e39b06-c084-4179-86ec-889bec7ed622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.332088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e0e39b06-c084-4179-86ec-889bec7ed622 None None] MFA Rules not processed for user `e2fb866e69fa4b3ebdbbbdaa044290ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:10.333419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e0e39b06-c084-4179-86ec-889bec7ed622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.353849 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f141f2c-56a3-4cb8-9b15-948285c8054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.356598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141f2c-56a3-4cb8-9b15-948285c8054c admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.356887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141f2c-56a3-4cb8-9b15-948285c8054c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.357295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141f2c-56a3-4cb8-9b15-948285c8054c admin admin] PATH_INFO: `/v3/projects/a6baf4aa0d22420cb97e0e340fa24621/users/2ca52e6437c74eab99f5c020087f234b/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.360469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f141f2c-56a3-4cb8-9b15-948285c8054c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6baf4aa0d22420cb97e0e340fa24621, user_id=2ca52e6437c74eab99f5c020087f234b, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.363144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f141f2c-56a3-4cb8-9b15-948285c8054c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.379238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 992/2006] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:10 2022] PUT /identity/v3/projects/a6baf4aa0d22420cb97e0e340fa24621/users/2ca52e6437c74eab99f5c020087f234b/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:10.392826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93823fb9-b936-4923-81cd-28bf9d3ab07a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.393420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93823fb9-b936-4923-81cd-28bf9d3ab07a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.393766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93823fb9-b936-4923-81cd-28bf9d3ab07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.434987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1015/2007] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:10.440514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-93823fb9-b936-4923-81cd-28bf9d3ab07a None None] MFA Rules not processed for user `2ca52e6437c74eab99f5c020087f234b`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:10.441951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-93823fb9-b936-4923-81cd-28bf9d3ab07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.450636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e39b06-c084-4179-86ec-889bec7ed622 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.450888 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e0e39b06-c084-4179-86ec-889bec7ed622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.527622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e39b06-c084-4179-86ec-889bec7ed622 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.542725 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 993/2008] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:10.559990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93823fb9-b936-4923-81cd-28bf9d3ab07a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.564389 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-93823fb9-b936-4923-81cd-28bf9d3ab07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.611321 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33286d6c-89db-48cb-a99b-ed0690397cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.611999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33286d6c-89db-48cb-a99b-ed0690397cbe service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.612323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33286d6c-89db-48cb-a99b-ed0690397cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.612616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33286d6c-89db-48cb-a99b-ed0690397cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.645369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93823fb9-b936-4923-81cd-28bf9d3ab07a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.649420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a66b2-6edf-453f-9aee-ab395c1e7580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.650057 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a66b2-6edf-453f-9aee-ab395c1e7580 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.651060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a66b2-6edf-453f-9aee-ab395c1e7580 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.651060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a66b2-6edf-453f-9aee-ab395c1e7580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.660965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a66b2-6edf-453f-9aee-ab395c1e7580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.662434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a66b2-6edf-453f-9aee-ab395c1e7580 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.672902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 994/2009] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:10.673850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a66b2-6edf-453f-9aee-ab395c1e7580 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.675173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-025a66b2-6edf-453f-9aee-ab395c1e7580 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.691557 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33286d6c-89db-48cb-a99b-ed0690397cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.693734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33286d6c-89db-48cb-a99b-ed0690397cbe service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.706404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1016/2010] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:10.712040 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33286d6c-89db-48cb-a99b-ed0690397cbe service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.746500 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a66b2-6edf-453f-9aee-ab395c1e7580 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.752641 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.753521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.753798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.754067 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] PATH_INFO: `/v3/projects/5ca0c768a6b64e159d937b8f4f5c6db4` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.757200 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca0c768a6b64e159d937b8f4f5c6db4)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.759198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.783380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33286d6c-89db-48cb-a99b-ed0690397cbe service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.788810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff8886-6da6-4a6d-8166-8afa967aa642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.789680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff8886-6da6-4a6d-8166-8afa967aa642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.789963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff8886-6da6-4a6d-8166-8afa967aa642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.790233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff8886-6da6-4a6d-8166-8afa967aa642 admin admin] PATH_INFO: `/v3/users/dc527be4c7454f768a57720bac6878ec` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.791477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff8886-6da6-4a6d-8166-8afa967aa642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc527be4c7454f768a57720bac6878ec)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.793523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff8886-6da6-4a6d-8166-8afa967aa642 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.818231 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca0c768a6b64e159d937b8f4f5c6db4', 'request_id': 'req-8f508b86-e7b5-478f-935e-20f17f5ef3c9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.825442 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca0c768a6b64e159d937b8f4f5c6db4', 'request_id': 'req-8f508b86-e7b5-478f-935e-20f17f5ef3c9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.832827 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca0c768a6b64e159d937b8f4f5c6db4', 'request_id': 'req-8f508b86-e7b5-478f-935e-20f17f5ef3c9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.849442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-02ff8886-6da6-4a6d-8166-8afa967aa642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc527be4c7454f768a57720bac6878ec'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.849582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] The token cache is being invalidate because project 5ca0c768a6b64e159d937b8f4f5c6db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:10.849896 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.851126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-02ff8886-6da6-4a6d-8166-8afa967aa642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc527be4c7454f768a57720bac6878ec'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.851256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.851362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-02ff8886-6da6-4a6d-8166-8afa967aa642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc527be4c7454f768a57720bac6878ec'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.854076 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 995/2011] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:10 2022] DELETE /identity/v3/projects/5ca0c768a6b64e159d937b8f4f5c6db4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:10.857824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.859190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.869403 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-02ff8886-6da6-4a6d-8166-8afa967aa642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc527be4c7454f768a57720bac6878ec'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.883052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-02ff8886-6da6-4a6d-8166-8afa967aa642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc527be4c7454f768a57720bac6878ec'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.905795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1017/2012] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:10 2022] DELETE /identity/v3/users/dc527be4c7454f768a57720bac6878ec => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:10.910441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485301af-7134-4250-accd-e6ad3d66991f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.919011 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485301af-7134-4250-accd-e6ad3d66991f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.919011 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485301af-7134-4250-accd-e6ad3d66991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.929060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f508b86-e7b5-478f-935e-20f17f5ef3c9 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.934472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-485301af-7134-4250-accd-e6ad3d66991f None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:10.935711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-485301af-7134-4250-accd-e6ad3d66991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.990962 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.991956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.992238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.992505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] PATH_INFO: `/v3/users/906263c1c584443a9605a32d658afb59` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.993691 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=906263c1c584443a9605a32d658afb59)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.996167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.998130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1018/2013] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:11.014154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485301af-7134-4250-accd-e6ad3d66991f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:11.015837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-485301af-7134-4250-accd-e6ad3d66991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:11.067145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '906263c1c584443a9605a32d658afb59'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.068265 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '906263c1c584443a9605a32d658afb59'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.086590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485301af-7134-4250-accd-e6ad3d66991f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:11.087473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '906263c1c584443a9605a32d658afb59'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.090997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f24d5d-bb53-4859-a1eb-165bfaaba96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:11.091346 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f24d5d-bb53-4859-a1eb-165bfaaba96c service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:11.091631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f24d5d-bb53-4859-a1eb-165bfaaba96c service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:11.091922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f24d5d-bb53-4859-a1eb-165bfaaba96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:11.094379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-23f24d5d-bb53-4859-a1eb-165bfaaba96c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:11.103470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '906263c1c584443a9605a32d658afb59'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.110150 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f24d5d-bb53-4859-a1eb-165bfaaba96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:11.112099 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '906263c1c584443a9605a32d658afb59'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.113004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f24d5d-bb53-4859-a1eb-165bfaaba96c service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:11.122613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 996/2014] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:10 2022] DELETE /identity/v3/users/906263c1c584443a9605a32d658afb59 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:11.132554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1019/2015] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:11.177537 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:11.178968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:11.247212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89cff3-17f9-4877-89eb-1d66c653ed81 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:11.252788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:11.253787 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:11.254062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:11.254328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] PATH_INFO: `/v3/users/7a03371372a146edb9ee374e72fa53f9` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:11.255592 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a03371372a146edb9ee374e72fa53f9)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:11.258300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:11.304482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a03371372a146edb9ee374e72fa53f9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.305150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a03371372a146edb9ee374e72fa53f9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.319238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a03371372a146edb9ee374e72fa53f9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.327823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a03371372a146edb9ee374e72fa53f9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.334218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a03371372a146edb9ee374e72fa53f9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.340892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 997/2016] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:11 2022] DELETE /identity/v3/users/7a03371372a146edb9ee374e72fa53f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:11.345607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b415bbc-bcde-414e-9a14-757a125ee036 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:11.345897 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b415bbc-bcde-414e-9a14-757a125ee036 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:11.346181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b415bbc-bcde-414e-9a14-757a125ee036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:11.385103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-8b415bbc-bcde-414e-9a14-757a125ee036 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:11.387317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8b415bbc-bcde-414e-9a14-757a125ee036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:11.459667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1020/2017] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:11.477780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:11.479386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:11.501788 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b415bbc-bcde-414e-9a14-757a125ee036 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:11.503432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8b415bbc-bcde-414e-9a14-757a125ee036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:11.519649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b415bbc-bcde-414e-9a14-757a125ee036 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:11.532066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:11.533041 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:11.533339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:11.533788 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] PATH_INFO: `/v3/projects/c5a5497c33be426fba3ddc27a96a7290` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:11.535232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a5497c33be426fba3ddc27a96a7290)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:11.537583 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:11.566820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fbb49-63b8-4198-a337-1b7e3f1f6153 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:11.570765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5341f-908b-46a8-9e99-56ac4b1b275d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:11.571320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5341f-908b-46a8-9e99-56ac4b1b275d service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:11.571602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5341f-908b-46a8-9e99-56ac4b1b275d service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:11.571880 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5341f-908b-46a8-9e99-56ac4b1b275d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:11.582657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5341f-908b-46a8-9e99-56ac4b1b275d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:11.585150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5341f-908b-46a8-9e99-56ac4b1b275d service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:11.600865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 998/2018] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:11.601704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5341f-908b-46a8-9e99-56ac4b1b275d service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:11.602228 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a5497c33be426fba3ddc27a96a7290', 'request_id': 'req-5fe1b07c-3ad4-4ad2-b372-9183000999f1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.608517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a5497c33be426fba3ddc27a96a7290', 'request_id': 'req-5fe1b07c-3ad4-4ad2-b372-9183000999f1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.612017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-afd5341f-908b-46a8-9e99-56ac4b1b275d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:11.615653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a5497c33be426fba3ddc27a96a7290', 'request_id': 'req-5fe1b07c-3ad4-4ad2-b372-9183000999f1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.629807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5341f-908b-46a8-9e99-56ac4b1b275d service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:11.633857 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] The token cache is being invalidate because project c5a5497c33be426fba3ddc27a96a7290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:11.634233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.635123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5fe1b07c-3ad4-4ad2-b372-9183000999f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.637307 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1021/2019] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:11 2022] DELETE /identity/v3/projects/c5a5497c33be426fba3ddc27a96a7290 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:11.642491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454cc94-50c4-4409-9d24-ac4e603324d0 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:11.642758 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454cc94-50c4-4409-9d24-ac4e603324d0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:11.643065 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454cc94-50c4-4409-9d24-ac4e603324d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:11.676913 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e454cc94-50c4-4409-9d24-ac4e603324d0 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:11.678203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e454cc94-50c4-4409-9d24-ac4e603324d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:11.748993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:11.750045 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:11.750323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:11.750592 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] PATH_INFO: `/v3/projects/2b0ae28929a14a62889b2d302419d2f2` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:11.751914 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0ae28929a14a62889b2d302419d2f2)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:11.754062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:11.763699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1022/2020] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:11.772719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858dc9-f854-4a2e-b56a-54a525266166 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:11.773012 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858dc9-f854-4a2e-b56a-54a525266166 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:11.773285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858dc9-f854-4a2e-b56a-54a525266166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:11.794702 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-bb858dc9-f854-4a2e-b56a-54a525266166 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:11.796125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-bb858dc9-f854-4a2e-b56a-54a525266166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:11.810765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1023/2021] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:11.812257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb858dc9-f854-4a2e-b56a-54a525266166 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:11.826600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb858dc9-f854-4a2e-b56a-54a525266166 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:11.840117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0ae28929a14a62889b2d302419d2f2', 'request_id': 'req-35019115-b3be-4c91-a84e-69966018faec'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.852022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0ae28929a14a62889b2d302419d2f2', 'request_id': 'req-35019115-b3be-4c91-a84e-69966018faec'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.865614 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0ae28929a14a62889b2d302419d2f2', 'request_id': 'req-35019115-b3be-4c91-a84e-69966018faec'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.886054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] The token cache is being invalidate because project 2b0ae28929a14a62889b2d302419d2f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:11.887078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.888225 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:11.892888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 999/2022] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:11 2022] DELETE /identity/v3/projects/2b0ae28929a14a62889b2d302419d2f2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:11.894370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:11.895977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:11.958513 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2a1d1-c17a-4e46-b1da-a9f53275b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:11.959390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2a1d1-c17a-4e46-b1da-a9f53275b837 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:11.959667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2a1d1-c17a-4e46-b1da-a9f53275b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:11.959936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2a1d1-c17a-4e46-b1da-a9f53275b837 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:11.960815 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2a1d1-c17a-4e46-b1da-a9f53275b837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:11.961127 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2a1d1-c17a-4e46-b1da-a9f53275b837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:11.962958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2a1d1-c17a-4e46-b1da-a9f53275b837 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:11.978610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1024/2023] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:11.984448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2a1d1-c17a-4e46-b1da-a9f53275b837 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:11.986407 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-1ef2a1d1-c17a-4e46-b1da-a9f53275b837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:12.008289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2a1d1-c17a-4e46-b1da-a9f53275b837 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.015130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d42c8-daa4-4651-ad5a-ba62741e8b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:12.016083 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d42c8-daa4-4651-ad5a-ba62741e8b76 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.016406 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d42c8-daa4-4651-ad5a-ba62741e8b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.016684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d42c8-daa4-4651-ad5a-ba62741e8b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.017391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d42c8-daa4-4651-ad5a-ba62741e8b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:12.018559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35019115-b3be-4c91-a84e-69966018faec admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.019596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d42c8-daa4-4651-ad5a-ba62741e8b76 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:12.024769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:12.025976 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.026660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.028081 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] PATH_INFO: `/v3/users/2ca52e6437c74eab99f5c020087f234b` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.029817 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca52e6437c74eab99f5c020087f234b)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:12.032240 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:12.070388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1025/2024] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:11 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:12.070388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d42c8-daa4-4651-ad5a-ba62741e8b76 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:12.072400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-289d42c8-daa4-4651-ad5a-ba62741e8b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:12.142153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca52e6437c74eab99f5c020087f234b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.142894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca52e6437c74eab99f5c020087f234b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.180337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca52e6437c74eab99f5c020087f234b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.189370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca52e6437c74eab99f5c020087f234b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.197870 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca52e6437c74eab99f5c020087f234b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.205094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1000/2025] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:11 2022] DELETE /identity/v3/users/2ca52e6437c74eab99f5c020087f234b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:12.205992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:12.207412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:12.221527 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d42c8-daa4-4651-ad5a-ba62741e8b76 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.285200 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b3a0b-9a05-49bd-88da-f3b5f5981926 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.289968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad06f1-ba33-4220-ac6f-f7a5472cf413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:12.290671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad06f1-ba33-4220-ac6f-f7a5472cf413 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.291012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad06f1-ba33-4220-ac6f-f7a5472cf413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.291277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad06f1-ba33-4220-ac6f-f7a5472cf413 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.291957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad06f1-ba33-4220-ac6f-f7a5472cf413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:12.292321 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:12.293143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.293420 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.293689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] PATH_INFO: `/v3/projects/01638350ace34faca06a0f57d40122ba` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.293974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad06f1-ba33-4220-ac6f-f7a5472cf413 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:12.294889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01638350ace34faca06a0f57d40122ba)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:12.296872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:12.315751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1001/2026] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:12 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:12.319759 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad06f1-ba33-4220-ac6f-f7a5472cf413 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:12.330756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad06f1-ba33-4220-ac6f-f7a5472cf413 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.336534 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f679f25-574c-4a45-8126-c46ee8bf8740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:12.337343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f679f25-574c-4a45-8126-c46ee8bf8740 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.337768 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f679f25-574c-4a45-8126-c46ee8bf8740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.338504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f679f25-574c-4a45-8126-c46ee8bf8740 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.339275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f679f25-574c-4a45-8126-c46ee8bf8740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:12.341026 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f679f25-574c-4a45-8126-c46ee8bf8740 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:12.354346 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01638350ace34faca06a0f57d40122ba', 'request_id': 'req-2f96b142-28b2-4604-8494-340ac8bcfb88'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.359005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1002/2027] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:12.361197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01638350ace34faca06a0f57d40122ba', 'request_id': 'req-2f96b142-28b2-4604-8494-340ac8bcfb88'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.367987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f679f25-574c-4a45-8126-c46ee8bf8740 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:12.368581 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01638350ace34faca06a0f57d40122ba', 'request_id': 'req-2f96b142-28b2-4604-8494-340ac8bcfb88'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.380706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f679f25-574c-4a45-8126-c46ee8bf8740 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.383917 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] The token cache is being invalidate because project 01638350ace34faca06a0f57d40122ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:12.384335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.385046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.387592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1026/2028] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:12 2022] DELETE /identity/v3/projects/01638350ace34faca06a0f57d40122ba => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:12.391660 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:12.393198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:12.449483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c87bb7-ba11-4f82-8f26-5404c539af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:12.450208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c87bb7-ba11-4f82-8f26-5404c539af8f admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.450512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c87bb7-ba11-4f82-8f26-5404c539af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.450782 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c87bb7-ba11-4f82-8f26-5404c539af8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.451529 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c87bb7-ba11-4f82-8f26-5404c539af8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:12.453190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c87bb7-ba11-4f82-8f26-5404c539af8f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:12.463432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1003/2029] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:12.467411 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c87bb7-ba11-4f82-8f26-5404c539af8f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:12.469729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d7c87bb7-ba11-4f82-8f26-5404c539af8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:12.472108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96b142-28b2-4604-8494-340ac8bcfb88 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.478068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f335e-c614-41a6-812c-48aaef23ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:12.479331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f335e-c614-41a6-812c-48aaef23ac71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.479634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f335e-c614-41a6-812c-48aaef23ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.480024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f335e-c614-41a6-812c-48aaef23ac71 admin admin] PATH_INFO: `/v3/users/e2fb866e69fa4b3ebdbbbdaa044290ad` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.481516 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f335e-c614-41a6-812c-48aaef23ac71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fb866e69fa4b3ebdbbbdaa044290ad)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:12.483849 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f335e-c614-41a6-812c-48aaef23ac71 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:12.486595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c87bb7-ba11-4f82-8f26-5404c539af8f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.495465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f669a6-2f85-4576-82c1-f5e84a866018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:12.497161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f669a6-2f85-4576-82c1-f5e84a866018 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.497649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f669a6-2f85-4576-82c1-f5e84a866018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.498130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f669a6-2f85-4576-82c1-f5e84a866018 admin admin] PATH_INFO: `/v3/projects/c4e06824bfeb416fa4a0651c055fb45b/users/fa9603b8530541828c592f5ddd5da11a/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.524572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f669a6-2f85-4576-82c1-f5e84a866018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e06824bfeb416fa4a0651c055fb45b, user_id=fa9603b8530541828c592f5ddd5da11a, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:12.527294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f669a6-2f85-4576-82c1-f5e84a866018 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:12.544565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-834f335e-c614-41a6-812c-48aaef23ac71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fb866e69fa4b3ebdbbbdaa044290ad'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.545303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-834f335e-c614-41a6-812c-48aaef23ac71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fb866e69fa4b3ebdbbbdaa044290ad'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.545418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1004/2030] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:12 2022] PUT /identity/v3/projects/c4e06824bfeb416fa4a0651c055fb45b/users/fa9603b8530541828c592f5ddd5da11a/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:12.546102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-834f335e-c614-41a6-812c-48aaef23ac71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fb866e69fa4b3ebdbbbdaa044290ad'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.546216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f669a6-2f85-4576-82c1-f5e84a866018 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:12.547840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c2f669a6-2f85-4576-82c1-f5e84a866018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:12.559114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-834f335e-c614-41a6-812c-48aaef23ac71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fb866e69fa4b3ebdbbbdaa044290ad'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.567250 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-834f335e-c614-41a6-812c-48aaef23ac71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fb866e69fa4b3ebdbbbdaa044290ad'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.580691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1027/2031] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:12 2022] DELETE /identity/v3/users/e2fb866e69fa4b3ebdbbbdaa044290ad => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:12.583766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02953bc-a953-4f5f-82f9-6c1e8ad90245 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.583766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02953bc-a953-4f5f-82f9-6c1e8ad90245 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.583766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02953bc-a953-4f5f-82f9-6c1e8ad90245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.610523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c02953bc-a953-4f5f-82f9-6c1e8ad90245 None None] MFA Rules not processed for user `fa9603b8530541828c592f5ddd5da11a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:12.612124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c02953bc-a953-4f5f-82f9-6c1e8ad90245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:12.628606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f669a6-2f85-4576-82c1-f5e84a866018 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.691762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1028/2032] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:12.697445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02953bc-a953-4f5f-82f9-6c1e8ad90245 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:12.699030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c02953bc-a953-4f5f-82f9-6c1e8ad90245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:12.718461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:12.719395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.719676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.719989 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] PATH_INFO: `/v3/projects/a6baf4aa0d22420cb97e0e340fa24621` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.721262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6baf4aa0d22420cb97e0e340fa24621)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:12.723333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:12.781488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6baf4aa0d22420cb97e0e340fa24621', 'request_id': 'req-10b00907-a784-4061-abfd-791073fb7b1f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.784408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02953bc-a953-4f5f-82f9-6c1e8ad90245 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.787290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6baf4aa0d22420cb97e0e340fa24621', 'request_id': 'req-10b00907-a784-4061-abfd-791073fb7b1f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.794226 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6baf4aa0d22420cb97e0e340fa24621', 'request_id': 'req-10b00907-a784-4061-abfd-791073fb7b1f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.808105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] The token cache is being invalidate because project a6baf4aa0d22420cb97e0e340fa24621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:12.808910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.809772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b00907-a784-4061-abfd-791073fb7b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:12.811466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1005/2033] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:12 2022] DELETE /identity/v3/projects/a6baf4aa0d22420cb97e0e340fa24621 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:12.816176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a390f-cdb3-44fd-8ce9-afa3edaa6cf9 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.816641 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a390f-cdb3-44fd-8ce9-afa3edaa6cf9 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.816989 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a390f-cdb3-44fd-8ce9-afa3edaa6cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.836358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-060a390f-cdb3-44fd-8ce9-afa3edaa6cf9 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:12.837652 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-060a390f-cdb3-44fd-8ce9-afa3edaa6cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:12.865643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea50c-e89c-40cd-8f9a-b1efabec5d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:12.866737 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea50c-e89c-40cd-8f9a-b1efabec5d7e admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.867313 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea50c-e89c-40cd-8f9a-b1efabec5d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.867742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea50c-e89c-40cd-8f9a-b1efabec5d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:12.868453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea50c-e89c-40cd-8f9a-b1efabec5d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:12.871472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea50c-e89c-40cd-8f9a-b1efabec5d7e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:12.905720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1029/2034] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:12 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:12.908561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea50c-e89c-40cd-8f9a-b1efabec5d7e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:12.911021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-703ea50c-e89c-40cd-8f9a-b1efabec5d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:12.941558 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1006/2035] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:12.942581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a390f-cdb3-44fd-8ce9-afa3edaa6cf9 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:12.948564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-060a390f-cdb3-44fd-8ce9-afa3edaa6cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:12.962805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a390f-cdb3-44fd-8ce9-afa3edaa6cf9 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.991964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea50c-e89c-40cd-8f9a-b1efabec5d7e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:12.997795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:12.998878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:12.999211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:12.999486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] PATH_INFO: `/v3/projects/b66ce6dce90d43ad97e3ddf8733b3d42` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.000692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66ce6dce90d43ad97e3ddf8733b3d42)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.002637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.031517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d97276-87cc-401a-a70d-2d919e86373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.032443 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d97276-87cc-401a-a70d-2d919e86373c admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.032866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d97276-87cc-401a-a70d-2d919e86373c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.033275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d97276-87cc-401a-a70d-2d919e86373c admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.034278 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d97276-87cc-401a-a70d-2d919e86373c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.036318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d97276-87cc-401a-a70d-2d919e86373c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.051178 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66ce6dce90d43ad97e3ddf8733b3d42', 'request_id': 'req-fed8da82-3f8d-46c6-bed5-bade90683d37'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:13.059052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66ce6dce90d43ad97e3ddf8733b3d42', 'request_id': 'req-fed8da82-3f8d-46c6-bed5-bade90683d37'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:13.062992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1007/2036] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:12 2022] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:13.064469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0884974-0b6e-4f11-8a3b-fb5646494da0 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.064888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0884974-0b6e-4f11-8a3b-fb5646494da0 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.065619 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0884974-0b6e-4f11-8a3b-fb5646494da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.068521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66ce6dce90d43ad97e3ddf8733b3d42', 'request_id': 'req-fed8da82-3f8d-46c6-bed5-bade90683d37'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:13.083070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] The token cache is being invalidate because project b66ce6dce90d43ad97e3ddf8733b3d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:13.083590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:13.084757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:13.087144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1030/2037] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:12 2022] DELETE /identity/v3/projects/b66ce6dce90d43ad97e3ddf8733b3d42 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:13.088164 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.088276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-b0884974-0b6e-4f11-8a3b-fb5646494da0 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:13.089993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.090283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b0884974-0b6e-4f11-8a3b-fb5646494da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.155793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1008/2038] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:13.157094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e5a0-96c3-4197-928d-248ca98ca3ea None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.157382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e5a0-96c3-4197-928d-248ca98ca3ea None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.157657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e5a0-96c3-4197-928d-248ca98ca3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.165705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8da82-3f8d-46c6-bed5-bade90683d37 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.171680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a777da-1ecd-46b2-9a4f-fa43cc4be19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.172545 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a777da-1ecd-46b2-9a4f-fa43cc4be19b admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.172987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a777da-1ecd-46b2-9a4f-fa43cc4be19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.173622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a777da-1ecd-46b2-9a4f-fa43cc4be19b admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.178294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-cbe4e5a0-96c3-4197-928d-248ca98ca3ea None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:13.178629 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a777da-1ecd-46b2-9a4f-fa43cc4be19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.179521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-cbe4e5a0-96c3-4197-928d-248ca98ca3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.180370 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a777da-1ecd-46b2-9a4f-fa43cc4be19b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.194115 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1009/2039] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:13.195061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4e5a0-96c3-4197-928d-248ca98ca3ea None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.199610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1031/2040] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:13.202388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef107f-d233-4817-8c29-6cf4c254f13a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.203290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef107f-d233-4817-8c29-6cf4c254f13a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.204175 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef107f-d233-4817-8c29-6cf4c254f13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.212577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4e5a0-96c3-4197-928d-248ca98ca3ea None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.219157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56966e4-e0c7-4008-ae99-37e7c230d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.220082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56966e4-e0c7-4008-ae99-37e7c230d736 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.220362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56966e4-e0c7-4008-ae99-37e7c230d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.220770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56966e4-e0c7-4008-ae99-37e7c230d736 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.221557 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56966e4-e0c7-4008-ae99-37e7c230d736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:13.221875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56966e4-e0c7-4008-ae99-37e7c230d736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.223910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56966e4-e0c7-4008-ae99-37e7c230d736 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.229403 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-abef107f-d233-4817-8c29-6cf4c254f13a None None] MFA Rules not processed for user `b17dd7414b474fcfb8406d11fef7e95d`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:13.231259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-abef107f-d233-4817-8c29-6cf4c254f13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.239963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1010/2041] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:13.241320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c58c32-e1b6-46f1-9cca-14c200010517 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.241755 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c58c32-e1b6-46f1-9cca-14c200010517 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.242023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c58c32-e1b6-46f1-9cca-14c200010517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.264546 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-41c58c32-e1b6-46f1-9cca-14c200010517 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:13.265828 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-41c58c32-e1b6-46f1-9cca-14c200010517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.279824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1011/2042] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:13.280658 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c58c32-e1b6-46f1-9cca-14c200010517 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.292074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c58c32-e1b6-46f1-9cca-14c200010517 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.300469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126909eb-8f06-4605-baf1-7667e9d173a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.300469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126909eb-8f06-4605-baf1-7667e9d173a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.300469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126909eb-8f06-4605-baf1-7667e9d173a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.300469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126909eb-8f06-4605-baf1-7667e9d173a9 admin admin] PATH_INFO: `/v3/projects/92d6a65dac0741eeb1eb237f19ad8762/users/97f9aa1da1104c1d8fd3de6775a1da5e/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.315061 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1032/2043] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:13.316004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef107f-d233-4817-8c29-6cf4c254f13a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.316660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126909eb-8f06-4605-baf1-7667e9d173a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d6a65dac0741eeb1eb237f19ad8762, user_id=97f9aa1da1104c1d8fd3de6775a1da5e, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.319813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126909eb-8f06-4605-baf1-7667e9d173a9 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.328735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef107f-d233-4817-8c29-6cf4c254f13a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.334373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1012/2044] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:13 2022] PUT /identity/v3/projects/92d6a65dac0741eeb1eb237f19ad8762/users/97f9aa1da1104c1d8fd3de6775a1da5e/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:13.338552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126909eb-8f06-4605-baf1-7667e9d173a9 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.414781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20e45e-2d6c-4998-9dcc-47f9b37f3864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.416374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20e45e-2d6c-4998-9dcc-47f9b37f3864 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.416837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20e45e-2d6c-4998-9dcc-47f9b37f3864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.417284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20e45e-2d6c-4998-9dcc-47f9b37f3864 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.419044 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20e45e-2d6c-4998-9dcc-47f9b37f3864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.421180 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20e45e-2d6c-4998-9dcc-47f9b37f3864 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.439930 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126909eb-8f06-4605-baf1-7667e9d173a9 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.445277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cbbfc-7c4a-4ec0-bd1d-282223b6bfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.446001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cbbfc-7c4a-4ec0-bd1d-282223b6bfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.446273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cbbfc-7c4a-4ec0-bd1d-282223b6bfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.446536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cbbfc-7c4a-4ec0-bd1d-282223b6bfe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.447271 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cbbfc-7c4a-4ec0-bd1d-282223b6bfe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:13.447625 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cbbfc-7c4a-4ec0-bd1d-282223b6bfe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.450405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cbbfc-7c4a-4ec0-bd1d-282223b6bfe6 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.451318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1033/2045] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:13 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:13.452378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20e45e-2d6c-4998-9dcc-47f9b37f3864 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.454501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-9f20e45e-2d6c-4998-9dcc-47f9b37f3864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.463746 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1013/2046] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:13.465184 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cbbfc-7c4a-4ec0-bd1d-282223b6bfe6 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.479173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cbbfc-7c4a-4ec0-bd1d-282223b6bfe6 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.524526 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20e45e-2d6c-4998-9dcc-47f9b37f3864 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.530507 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.531415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.531701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.531980 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] PATH_INFO: `/v3/users/e11a5132c4804c8f858d8058678ca834` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.534282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e11a5132c4804c8f858d8058678ca834)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.536247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.551022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e8337-84ed-4818-a853-877567fdefc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.551725 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8337-84ed-4818-a853-877567fdefc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.552005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8337-84ed-4818-a853-877567fdefc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.552318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8337-84ed-4818-a853-877567fdefc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.553075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e8337-84ed-4818-a853-877567fdefc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.554834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e8337-84ed-4818-a853-877567fdefc3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.566361 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1014/2047] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:13.567255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e8337-84ed-4818-a853-877567fdefc3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.577731 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e8337-84ed-4818-a853-877567fdefc3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.582459 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f14e2-6689-412f-925a-aaf1bc27425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.583147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f14e2-6689-412f-925a-aaf1bc27425e admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.583426 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f14e2-6689-412f-925a-aaf1bc27425e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.583696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f14e2-6689-412f-925a-aaf1bc27425e admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.584534 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f14e2-6689-412f-925a-aaf1bc27425e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.586452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f14e2-6689-412f-925a-aaf1bc27425e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.591109 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e11a5132c4804c8f858d8058678ca834'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:13.592060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e11a5132c4804c8f858d8058678ca834'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:13.593342 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e11a5132c4804c8f858d8058678ca834'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:13.611209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1015/2048] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:13 2022] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:13.612075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f14e2-6689-412f-925a-aaf1bc27425e admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.613670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c41f14e2-6689-412f-925a-aaf1bc27425e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.615373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e11a5132c4804c8f858d8058678ca834'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:13.623479 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e11a5132c4804c8f858d8058678ca834'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:13.626809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f14e2-6689-412f-925a-aaf1bc27425e admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.632092 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28e591-79de-45d8-9705-4b0afdbf72c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.632742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28e591-79de-45d8-9705-4b0afdbf72c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.633091 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28e591-79de-45d8-9705-4b0afdbf72c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.633362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28e591-79de-45d8-9705-4b0afdbf72c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.634091 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28e591-79de-45d8-9705-4b0afdbf72c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.636722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28e591-79de-45d8-9705-4b0afdbf72c7 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.637245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1034/2049] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:13 2022] DELETE /identity/v3/users/e11a5132c4804c8f858d8058678ca834 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:13.641913 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.643578 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.666947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1016/2050] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:13 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:13.667794 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28e591-79de-45d8-9705-4b0afdbf72c7 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.669691 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-fb28e591-79de-45d8-9705-4b0afdbf72c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.720468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0c19-f98f-4c81-935e-c886e638ddcc admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.733140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28e591-79de-45d8-9705-4b0afdbf72c7 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.738155 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2232245-4c00-4d07-ac2a-b74688b841f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.738818 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232245-4c00-4d07-ac2a-b74688b841f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.739399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232245-4c00-4d07-ac2a-b74688b841f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.739399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232245-4c00-4d07-ac2a-b74688b841f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.740096 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2232245-4c00-4d07-ac2a-b74688b841f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.741931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2232245-4c00-4d07-ac2a-b74688b841f0 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.752125 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1017/2051] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:13.753588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b6c90-2d2d-4eaa-8f6e-beb84ec23b23 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.753875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b6c90-2d2d-4eaa-8f6e-beb84ec23b23 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.754147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b6c90-2d2d-4eaa-8f6e-beb84ec23b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.772452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-9b8b6c90-2d2d-4eaa-8f6e-beb84ec23b23 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:13.773631 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9b8b6c90-2d2d-4eaa-8f6e-beb84ec23b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.781749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18a725-046f-49f8-9773-c4b63297ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.782810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18a725-046f-49f8-9773-c4b63297ecac admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.783143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18a725-046f-49f8-9773-c4b63297ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.783405 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18a725-046f-49f8-9773-c4b63297ecac admin admin] PATH_INFO: `/v3/projects/92d6a65dac0741eeb1eb237f19ad8762/users/97f9aa1da1104c1d8fd3de6775a1da5e/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.785072 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1018/2052] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:13.785404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18a725-046f-49f8-9773-c4b63297ecac admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d6a65dac0741eeb1eb237f19ad8762, user_id=97f9aa1da1104c1d8fd3de6775a1da5e, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.785902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b6c90-2d2d-4eaa-8f6e-beb84ec23b23 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.788125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18a725-046f-49f8-9773-c4b63297ecac admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.796626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b6c90-2d2d-4eaa-8f6e-beb84ec23b23 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.806989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1035/2053] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:13 2022] PUT /identity/v3/projects/92d6a65dac0741eeb1eb237f19ad8762/users/97f9aa1da1104c1d8fd3de6775a1da5e/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:13.811165 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18a725-046f-49f8-9773-c4b63297ecac admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.855088 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cb7f5-7a4b-4a9e-9343-5f783da244fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.855756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cb7f5-7a4b-4a9e-9343-5f783da244fd admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.856272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cb7f5-7a4b-4a9e-9343-5f783da244fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.856272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cb7f5-7a4b-4a9e-9343-5f783da244fd admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.857003 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cb7f5-7a4b-4a9e-9343-5f783da244fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.858987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cb7f5-7a4b-4a9e-9343-5f783da244fd admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.876173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18a725-046f-49f8-9773-c4b63297ecac admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.879628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1019/2054] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:13 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:13.880670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cb7f5-7a4b-4a9e-9343-5f783da244fd admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.882748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-431cb7f5-7a4b-4a9e-9343-5f783da244fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.885509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9623871-2e76-40e1-ad2a-cc49605903e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.887269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623871-2e76-40e1-ad2a-cc49605903e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.887558 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623871-2e76-40e1-ad2a-cc49605903e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.887827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623871-2e76-40e1-ad2a-cc49605903e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.888661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9623871-2e76-40e1-ad2a-cc49605903e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.890384 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9623871-2e76-40e1-ad2a-cc49605903e5 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.901898 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1036/2055] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:13.903598 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d06d2f-2808-4985-838b-59a8e14aa377 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.904159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d06d2f-2808-4985-838b-59a8e14aa377 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.904596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d06d2f-2808-4985-838b-59a8e14aa377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.932208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-54d06d2f-2808-4985-838b-59a8e14aa377 None None] MFA Rules not processed for user `97f9aa1da1104c1d8fd3de6775a1da5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:13.933958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-54d06d2f-2808-4985-838b-59a8e14aa377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:13.956456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cb7f5-7a4b-4a9e-9343-5f783da244fd admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:13.961061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd6b86-c31c-446b-8642-34310fe31c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:13.961815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd6b86-c31c-446b-8642-34310fe31c38 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:13.962158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd6b86-c31c-446b-8642-34310fe31c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:13.962499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd6b86-c31c-446b-8642-34310fe31c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:13.975771 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd6b86-c31c-446b-8642-34310fe31c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:13.977330 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd6b86-c31c-446b-8642-34310fe31c38 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:13.987760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1020/2056] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:13.988672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd6b86-c31c-446b-8642-34310fe31c38 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:13.999536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd6b86-c31c-446b-8642-34310fe31c38 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:14.004745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3161679-a9be-43f4-a47e-370039f09c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:14.005527 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161679-a9be-43f4-a47e-370039f09c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.005872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161679-a9be-43f4-a47e-370039f09c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.006206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161679-a9be-43f4-a47e-370039f09c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.007454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3161679-a9be-43f4-a47e-370039f09c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:14.009377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3161679-a9be-43f4-a47e-370039f09c42 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:14.020722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1037/2057] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:14.024772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1021/2058] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:14.025243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d06d2f-2808-4985-838b-59a8e14aa377 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.032665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3161679-a9be-43f4-a47e-370039f09c42 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.036272 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d06d2f-2808-4985-838b-59a8e14aa377 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:14.041142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7e14-0282-4149-a393-f6af22c662d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:14.042110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7e14-0282-4149-a393-f6af22c662d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.042360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7e14-0282-4149-a393-f6af22c662d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.042613 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7e14-0282-4149-a393-f6af22c662d3 admin admin] PATH_INFO: `/v3/projects/c6342293c1f74a629d3f9097a3815571/users/2d4da73ac92b47f4b9d4b393dea47d64/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.045396 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3161679-a9be-43f4-a47e-370039f09c42 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:14.051679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92cf5a-bab7-4a76-be55-c5402249a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:14.052397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92cf5a-bab7-4a76-be55-c5402249a772 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.052745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92cf5a-bab7-4a76-be55-c5402249a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.053018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92cf5a-bab7-4a76-be55-c5402249a772 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.055176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92cf5a-bab7-4a76-be55-c5402249a772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:14.057794 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92cf5a-bab7-4a76-be55-c5402249a772 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:14.062757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e7e14-0282-4149-a393-f6af22c662d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6342293c1f74a629d3f9097a3815571, user_id=2d4da73ac92b47f4b9d4b393dea47d64, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:14.065563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e7e14-0282-4149-a393-f6af22c662d3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:14.073359 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1022/2059] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:14.075292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92cf5a-bab7-4a76-be55-c5402249a772 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.079384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-bf92cf5a-bab7-4a76-be55-c5402249a772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:14.088264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1038/2060] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:14 2022] PUT /identity/v3/projects/c6342293c1f74a629d3f9097a3815571/users/2d4da73ac92b47f4b9d4b393dea47d64/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:14.089168 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7e14-0282-4149-a393-f6af22c662d3 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.165129 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92cf5a-bab7-4a76-be55-c5402249a772 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:14.184464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7e14-0282-4149-a393-f6af22c662d3 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:14.193308 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2c36a-4d49-4a30-a3df-c93d13407c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:14.195863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c36a-4d49-4a30-a3df-c93d13407c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.196989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c36a-4d49-4a30-a3df-c93d13407c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.197339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c36a-4d49-4a30-a3df-c93d13407c0a admin admin] PATH_INFO: `/v3/projects/f8840d06a0454fa2b53a360075a94b32/users/9c919648caa7461a8ebe78c0b450fdbe/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.219078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2c36a-4d49-4a30-a3df-c93d13407c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8840d06a0454fa2b53a360075a94b32, user_id=9c919648caa7461a8ebe78c0b450fdbe, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:14.222266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2c36a-4d49-4a30-a3df-c93d13407c0a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:14.235310 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542c52d-c1e5-489d-aba7-18c4e0917a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:14.236487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c52d-c1e5-489d-aba7-18c4e0917a6f service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.236913 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c52d-c1e5-489d-aba7-18c4e0917a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.237286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c52d-c1e5-489d-aba7-18c4e0917a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.240450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1039/2061] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:14 2022] PUT /identity/v3/projects/f8840d06a0454fa2b53a360075a94b32/users/9c919648caa7461a8ebe78c0b450fdbe/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:14.242246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73c34-b3b3-43c3-b3d5-f8815b66d1f0 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.242719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73c34-b3b3-43c3-b3d5-f8815b66d1f0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.243276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73c34-b3b3-43c3-b3d5-f8815b66d1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.274376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-4ac73c34-b3b3-43c3-b3d5-f8815b66d1f0 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:14.275915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4ac73c34-b3b3-43c3-b3d5-f8815b66d1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:14.329671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542c52d-c1e5-489d-aba7-18c4e0917a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:14.331598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542c52d-c1e5-489d-aba7-18c4e0917a6f service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:14.343730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1023/2062] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:14.357522 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eeb8c-f8e0-4757-8bb6-1a5e5cc0bf96 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.366877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eeb8c-f8e0-4757-8bb6-1a5e5cc0bf96 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.367188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eeb8c-f8e0-4757-8bb6-1a5e5cc0bf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.370301 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1040/2063] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:14.372310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73c34-b3b3-43c3-b3d5-f8815b66d1f0 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.373855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4ac73c34-b3b3-43c3-b3d5-f8815b66d1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:14.390642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73c34-b3b3-43c3-b3d5-f8815b66d1f0 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:14.406498 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:14.407657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.408140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.408491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] PATH_INFO: `/v3/projects/5db6f7b7be0449af84838ab4670471b7` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.410468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db6f7b7be0449af84838ab4670471b7)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:14.416904 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:14.443117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-973eeb8c-f8e0-4757-8bb6-1a5e5cc0bf96 None None] MFA Rules not processed for user `9c919648caa7461a8ebe78c0b450fdbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:14.443938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-973eeb8c-f8e0-4757-8bb6-1a5e5cc0bf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:14.503801 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db6f7b7be0449af84838ab4670471b7', 'request_id': 'req-2ea5f631-a7b3-49be-9067-75a95deffca2'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:14.514878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db6f7b7be0449af84838ab4670471b7', 'request_id': 'req-2ea5f631-a7b3-49be-9067-75a95deffca2'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:14.522862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db6f7b7be0449af84838ab4670471b7', 'request_id': 'req-2ea5f631-a7b3-49be-9067-75a95deffca2'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:14.536963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1024/2064] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:14.541214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973eeb8c-f8e0-4757-8bb6-1a5e5cc0bf96 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.546800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] The token cache is being invalidate because project 5db6f7b7be0449af84838ab4670471b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:14.547264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:14.548085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:14.550104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1041/2065] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:14 2022] DELETE /identity/v3/projects/5db6f7b7be0449af84838ab4670471b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:14.551724 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.553353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:14.616148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973eeb8c-f8e0-4757-8bb6-1a5e5cc0bf96 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:14.684522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5f631-a7b3-49be-9067-75a95deffca2 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:14.687808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf6b0a-6f71-441c-9c86-13c329e99b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:14.688390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6b0a-6f71-441c-9c86-13c329e99b0b service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.688669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6b0a-6f71-441c-9c86-13c329e99b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.688935 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6b0a-6f71-441c-9c86-13c329e99b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.690977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-09bf6b0a-6f71-441c-9c86-13c329e99b0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:14.691939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e46c2-692d-456d-b7f8-4a152d66febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:14.692764 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e46c2-692d-456d-b7f8-4a152d66febf admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.693207 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e46c2-692d-456d-b7f8-4a152d66febf admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.694875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e46c2-692d-456d-b7f8-4a152d66febf admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.696345 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e46c2-692d-456d-b7f8-4a152d66febf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:14.700531 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e46c2-692d-456d-b7f8-4a152d66febf admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:14.704460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf6b0a-6f71-441c-9c86-13c329e99b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:14.705896 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf6b0a-6f71-441c-9c86-13c329e99b0b service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:14.716238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1025/2066] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:14.717053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf6b0a-6f71-441c-9c86-13c329e99b0b service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.718308 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-09bf6b0a-6f71-441c-9c86-13c329e99b0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:14.732339 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf6b0a-6f71-441c-9c86-13c329e99b0b service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:14.736262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1042/2067] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:14 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:14.737493 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e46c2-692d-456d-b7f8-4a152d66febf admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.848136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:14.849960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.851006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.851006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] PATH_INFO: `/v3/users/7de874187f9b487da07fc63073ceb5f8` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.853250 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de874187f9b487da07fc63073ceb5f8)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:14.858432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:14.878498 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e46c2-692d-456d-b7f8-4a152d66febf admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:14.884798 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402df03-f786-4fbe-a99a-98a7bb50d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:14.885154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402df03-f786-4fbe-a99a-98a7bb50d139 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.885889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402df03-f786-4fbe-a99a-98a7bb50d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.886728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402df03-f786-4fbe-a99a-98a7bb50d139 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.888171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402df03-f786-4fbe-a99a-98a7bb50d139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:14.891517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402df03-f786-4fbe-a99a-98a7bb50d139 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:14.923194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1043/2068] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:14 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:14.924372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de874187f9b487da07fc63073ceb5f8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:14.924515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402df03-f786-4fbe-a99a-98a7bb50d139 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.925499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de874187f9b487da07fc63073ceb5f8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:14.941144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de874187f9b487da07fc63073ceb5f8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:14.941273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402df03-f786-4fbe-a99a-98a7bb50d139 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:14.949194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3482a7-34e5-45af-a3da-e9aa94d5e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:14.950110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3482a7-34e5-45af-a3da-e9aa94d5e22e admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:14.950468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3482a7-34e5-45af-a3da-e9aa94d5e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:14.950821 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3482a7-34e5-45af-a3da-e9aa94d5e22e admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:14.951645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3482a7-34e5-45af-a3da-e9aa94d5e22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:14.952493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de874187f9b487da07fc63073ceb5f8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:14.953759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3482a7-34e5-45af-a3da-e9aa94d5e22e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:14.960201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de874187f9b487da07fc63073ceb5f8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:14.965785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1044/2069] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:14.967617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1026/2070] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:14 2022] DELETE /identity/v3/users/7de874187f9b487da07fc63073ceb5f8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:14.969790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3482a7-34e5-45af-a3da-e9aa94d5e22e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.971252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:14.972050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ad3482a7-34e5-45af-a3da-e9aa94d5e22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:14.973132 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:14.987306 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3482a7-34e5-45af-a3da-e9aa94d5e22e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:15.053868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac503800-af82-4394-8d2a-b968b5b7a938 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:15.061620 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af17989-b7b8-4220-b2d3-ae9ea0d2e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:15.062619 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874df57-cd2b-4404-8d21-ed35cdbf6045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:15.062765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af17989-b7b8-4220-b2d3-ae9ea0d2e39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:15.063358 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af17989-b7b8-4220-b2d3-ae9ea0d2e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:15.063665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874df57-cd2b-4404-8d21-ed35cdbf6045 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:15.063858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af17989-b7b8-4220-b2d3-ae9ea0d2e39f admin admin] PATH_INFO: `/v3/users/fa9603b8530541828c592f5ddd5da11a` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:15.064328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874df57-cd2b-4404-8d21-ed35cdbf6045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:15.064664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874df57-cd2b-4404-8d21-ed35cdbf6045 admin admin] PATH_INFO: `/v3/projects/2f828dfd8f6e492fbf9d4ebcd25a610c/users/79502f94104340b3a8508f1c33ec14a9/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:15.066001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af17989-b7b8-4220-b2d3-ae9ea0d2e39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa9603b8530541828c592f5ddd5da11a)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:15.068544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af17989-b7b8-4220-b2d3-ae9ea0d2e39f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:15.099755 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874df57-cd2b-4404-8d21-ed35cdbf6045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f828dfd8f6e492fbf9d4ebcd25a610c, user_id=79502f94104340b3a8508f1c33ec14a9, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:15.103460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874df57-cd2b-4404-8d21-ed35cdbf6045 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:15.120867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1027/2071] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:14 2022] PUT /identity/v3/projects/2f828dfd8f6e492fbf9d4ebcd25a610c/users/79502f94104340b3a8508f1c33ec14a9/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:15.125420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874df57-cd2b-4404-8d21-ed35cdbf6045 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:15.145823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2af17989-b7b8-4220-b2d3-ae9ea0d2e39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa9603b8530541828c592f5ddd5da11a'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:15.147408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2af17989-b7b8-4220-b2d3-ae9ea0d2e39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa9603b8530541828c592f5ddd5da11a'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:15.148335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2af17989-b7b8-4220-b2d3-ae9ea0d2e39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa9603b8530541828c592f5ddd5da11a'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:15.171570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2af17989-b7b8-4220-b2d3-ae9ea0d2e39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa9603b8530541828c592f5ddd5da11a'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:15.191338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2af17989-b7b8-4220-b2d3-ae9ea0d2e39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa9603b8530541828c592f5ddd5da11a'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:15.220230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1045/2072] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:14 2022] DELETE /identity/v3/users/fa9603b8530541828c592f5ddd5da11a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:15.224397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304926-8fbf-4a24-b07e-1f88859d95ea None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:15.224943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304926-8fbf-4a24-b07e-1f88859d95ea None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:15.225294 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304926-8fbf-4a24-b07e-1f88859d95ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:15.247163 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874df57-cd2b-4404-8d21-ed35cdbf6045 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:15.251671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-8d304926-8fbf-4a24-b07e-1f88859d95ea None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:15.253011 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8d304926-8fbf-4a24-b07e-1f88859d95ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:15.356110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1046/2073] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:15.358887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cb1ca-5ccb-4fa2-9979-2e566760f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:15.359625 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cb1ca-5ccb-4fa2-9979-2e566760f106 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:15.359906 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cb1ca-5ccb-4fa2-9979-2e566760f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:15.360179 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cb1ca-5ccb-4fa2-9979-2e566760f106 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:15.361072 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cb1ca-5ccb-4fa2-9979-2e566760f106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:15.362692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cb1ca-5ccb-4fa2-9979-2e566760f106 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:15.378528 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d304926-8fbf-4a24-b07e-1f88859d95ea None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:15.384314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1028/2074] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:15.388280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8d304926-8fbf-4a24-b07e-1f88859d95ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:15.388650 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cb1ca-5ccb-4fa2-9979-2e566760f106 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:15.390560 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f47cb1ca-5ccb-4fa2-9979-2e566760f106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:15.409869 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cb1ca-5ccb-4fa2-9979-2e566760f106 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:15.416822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7299d25-2d83-4055-a23b-6fd6bfa50963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:15.417863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7299d25-2d83-4055-a23b-6fd6bfa50963 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:15.418615 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7299d25-2d83-4055-a23b-6fd6bfa50963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:15.418925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7299d25-2d83-4055-a23b-6fd6bfa50963 admin admin] PATH_INFO: `/v3/projects/2f828dfd8f6e492fbf9d4ebcd25a610c/users/79502f94104340b3a8508f1c33ec14a9/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:15.422431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7299d25-2d83-4055-a23b-6fd6bfa50963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f828dfd8f6e492fbf9d4ebcd25a610c, user_id=79502f94104340b3a8508f1c33ec14a9, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:15.425769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7299d25-2d83-4055-a23b-6fd6bfa50963 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:15.443120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1029/2075] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:15 2022] PUT /identity/v3/projects/2f828dfd8f6e492fbf9d4ebcd25a610c/users/79502f94104340b3a8508f1c33ec14a9/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:15.456680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7267c-b07c-4d69-a505-5d6d2ae4b5c9 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:15.457012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7267c-b07c-4d69-a505-5d6d2ae4b5c9 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:15.457382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7267c-b07c-4d69-a505-5d6d2ae4b5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:15.466182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d304926-8fbf-4a24-b07e-1f88859d95ea None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:15.525985 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-96e7267c-b07c-4d69-a505-5d6d2ae4b5c9 None None] MFA Rules not processed for user `79502f94104340b3a8508f1c33ec14a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:15.527499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-96e7267c-b07c-4d69-a505-5d6d2ae4b5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:15.531968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746d493-37fc-4974-a4d9-d7b206e988b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:15.532627 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746d493-37fc-4974-a4d9-d7b206e988b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:15.532908 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746d493-37fc-4974-a4d9-d7b206e988b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:15.533178 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746d493-37fc-4974-a4d9-d7b206e988b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:15.644988 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746d493-37fc-4974-a4d9-d7b206e988b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:15.649214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746d493-37fc-4974-a4d9-d7b206e988b6 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:15.669991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1047/2076] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:15.670807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746d493-37fc-4974-a4d9-d7b206e988b6 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:15.672551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-1746d493-37fc-4974-a4d9-d7b206e988b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:15.690828 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746d493-37fc-4974-a4d9-d7b206e988b6 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:15.692987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1030/2077] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:15.698767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee395d-e74a-402e-a24e-4fcbef1c040a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:15.698767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee395d-e74a-402e-a24e-4fcbef1c040a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:15.698767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee395d-e74a-402e-a24e-4fcbef1c040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:15.705177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:15.706469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:15.706628 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:15.707173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] PATH_INFO: `/v3/projects/54cebbea91184fa887fff6097e954d3f` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:15.708676 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54cebbea91184fa887fff6097e954d3f)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:15.710948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:15.748690 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e1ee395d-e74a-402e-a24e-4fcbef1c040a None None] MFA Rules not processed for user `2d4da73ac92b47f4b9d4b393dea47d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:15.750049 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e1ee395d-e74a-402e-a24e-4fcbef1c040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:15.798892 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54cebbea91184fa887fff6097e954d3f', 'request_id': 'req-cf0948df-488f-4bf7-afb5-60d2925f80d6'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:15.807797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54cebbea91184fa887fff6097e954d3f', 'request_id': 'req-cf0948df-488f-4bf7-afb5-60d2925f80d6'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:15.817802 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54cebbea91184fa887fff6097e954d3f', 'request_id': 'req-cf0948df-488f-4bf7-afb5-60d2925f80d6'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:15.836148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] The token cache is being invalidate because project 54cebbea91184fa887fff6097e954d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:15.836449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:15.837209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:15.839515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1048/2078] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:15 2022] DELETE /identity/v3/projects/54cebbea91184fa887fff6097e954d3f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:15.840460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:15.843524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:15.910645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1031/2079] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:15.911525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee395d-e74a-402e-a24e-4fcbef1c040a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:15.912892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e1ee395d-e74a-402e-a24e-4fcbef1c040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:15.936381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee395d-e74a-402e-a24e-4fcbef1c040a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:15.957483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0948df-488f-4bf7-afb5-60d2925f80d6 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:15.969351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c723c6-d995-44fc-94cc-1cb7cbe050aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:15.973894 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c723c6-d995-44fc-94cc-1cb7cbe050aa service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:15.974212 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c723c6-d995-44fc-94cc-1cb7cbe050aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:15.974497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c723c6-d995-44fc-94cc-1cb7cbe050aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:15.977766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-96c723c6-d995-44fc-94cc-1cb7cbe050aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:16.055178 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:16.057327 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:16.057768 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:16.058202 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] PATH_INFO: `/v3/users/c4e386f766e445288572cb61ba28f648` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:16.060405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e386f766e445288572cb61ba28f648)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:16.063772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:16.083197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c723c6-d995-44fc-94cc-1cb7cbe050aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:16.088049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c723c6-d995-44fc-94cc-1cb7cbe050aa service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:16.100981 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1049/2080] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:16.101987 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c723c6-d995-44fc-94cc-1cb7cbe050aa service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:16.104369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-96c723c6-d995-44fc-94cc-1cb7cbe050aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:16.118686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c723c6-d995-44fc-94cc-1cb7cbe050aa service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:16.128976 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c9fae-78a3-4b5a-86a2-daf05c45aeca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:16.130245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c9fae-78a3-4b5a-86a2-daf05c45aeca service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:16.130529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c9fae-78a3-4b5a-86a2-daf05c45aeca service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:16.130924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c9fae-78a3-4b5a-86a2-daf05c45aeca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:16.134379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e386f766e445288572cb61ba28f648'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.135978 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e386f766e445288572cb61ba28f648'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.171763 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e386f766e445288572cb61ba28f648'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.187424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e386f766e445288572cb61ba28f648'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.205648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e386f766e445288572cb61ba28f648'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.220501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1032/2081] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:15 2022] DELETE /identity/v3/users/c4e386f766e445288572cb61ba28f648 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:16.223362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:16.225706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:16.266113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c9fae-78a3-4b5a-86a2-daf05c45aeca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:16.269582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c9fae-78a3-4b5a-86a2-daf05c45aeca service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:16.296269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1050/2082] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:16.333421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd803d8-6596-49f1-a5c8-195330480fe8 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:16.341749 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:16.342949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:16.343224 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:16.343514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] PATH_INFO: `/v3/projects/c4e06824bfeb416fa4a0651c055fb45b` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:16.344875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e06824bfeb416fa4a0651c055fb45b)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:16.347249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:16.355856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c9fae-78a3-4b5a-86a2-daf05c45aeca service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:16.357448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-bf7c9fae-78a3-4b5a-86a2-daf05c45aeca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:16.385645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c9fae-78a3-4b5a-86a2-daf05c45aeca service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:16.391627 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9b0b2-c542-432f-93cd-f80de56f846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:16.392545 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9b0b2-c542-432f-93cd-f80de56f846f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:16.392899 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9b0b2-c542-432f-93cd-f80de56f846f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:16.393264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9b0b2-c542-432f-93cd-f80de56f846f admin admin] PATH_INFO: `/v3/users/9c919648caa7461a8ebe78c0b450fdbe` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:16.394678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9b0b2-c542-432f-93cd-f80de56f846f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c919648caa7461a8ebe78c0b450fdbe)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:16.396847 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9b0b2-c542-432f-93cd-f80de56f846f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:16.420426 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e06824bfeb416fa4a0651c055fb45b', 'request_id': 'req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.427807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e06824bfeb416fa4a0651c055fb45b', 'request_id': 'req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.436731 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e06824bfeb416fa4a0651c055fb45b', 'request_id': 'req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.463831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] The token cache is being invalidate because project c4e06824bfeb416fa4a0651c055fb45b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:16.465121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.468716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.481787 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1033/2083] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:16 2022] DELETE /identity/v3/projects/c4e06824bfeb416fa4a0651c055fb45b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:16.485148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:16.487834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:16.502211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cde9b0b2-c542-432f-93cd-f80de56f846f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c919648caa7461a8ebe78c0b450fdbe'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.503263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cde9b0b2-c542-432f-93cd-f80de56f846f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c919648caa7461a8ebe78c0b450fdbe'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.505053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cde9b0b2-c542-432f-93cd-f80de56f846f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c919648caa7461a8ebe78c0b450fdbe'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.534277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cde9b0b2-c542-432f-93cd-f80de56f846f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c919648caa7461a8ebe78c0b450fdbe'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.551998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cde9b0b2-c542-432f-93cd-f80de56f846f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c919648caa7461a8ebe78c0b450fdbe'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.571262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1051/2084] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:16 2022] DELETE /identity/v3/users/9c919648caa7461a8ebe78c0b450fdbe => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:16.576916 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b840d-df2d-41cd-b366-bc517c452eed None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:16.577206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b840d-df2d-41cd-b366-bc517c452eed None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:16.577482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b840d-df2d-41cd-b366-bc517c452eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:16.584096 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be45b7-8c01-43e1-af23-ff5e26cf6b1d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:16.616397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-aa1b840d-df2d-41cd-b366-bc517c452eed None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:16.617649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-aa1b840d-df2d-41cd-b366-bc517c452eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:16.693467 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1052/2085] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:16.696628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:16.697822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:16.698257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:16.698720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] PATH_INFO: `/v3/users/97f9aa1da1104c1d8fd3de6775a1da5e` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:16.700148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f9aa1da1104c1d8fd3de6775a1da5e)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:16.702940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:16.707829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b840d-df2d-41cd-b366-bc517c452eed None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:16.709694 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-aa1b840d-df2d-41cd-b366-bc517c452eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:16.816090 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f9aa1da1104c1d8fd3de6775a1da5e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.817148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f9aa1da1104c1d8fd3de6775a1da5e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.836509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b840d-df2d-41cd-b366-bc517c452eed None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:16.843247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b97e8-2268-42db-9302-b601aafa62a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:16.844104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b97e8-2268-42db-9302-b601aafa62a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:16.844886 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b97e8-2268-42db-9302-b601aafa62a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:16.845169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f9aa1da1104c1d8fd3de6775a1da5e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.845603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b97e8-2268-42db-9302-b601aafa62a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:16.848693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e84b97e8-2268-42db-9302-b601aafa62a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:16.853759 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f9aa1da1104c1d8fd3de6775a1da5e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.867240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b97e8-2268-42db-9302-b601aafa62a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:16.867370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f9aa1da1104c1d8fd3de6775a1da5e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:16.869420 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b97e8-2268-42db-9302-b601aafa62a5 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:16.880118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1034/2086] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:16 2022] DELETE /identity/v3/users/97f9aa1da1104c1d8fd3de6775a1da5e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:16.881036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:16.883749 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:16.885399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1053/2087] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:16.959303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2a07d-3601-4589-a7c6-409259a90210 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:16.965128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:16.966149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:16.966436 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:16.966817 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] PATH_INFO: `/v3/projects/dea701672dbd47a8917aab5ef7e8797f` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:16.968149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea701672dbd47a8917aab5ef7e8797f)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:16.970114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:17.027896 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea701672dbd47a8917aab5ef7e8797f', 'request_id': 'req-b46d5afc-4f2c-4b01-94c8-8c153b740926'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.035851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea701672dbd47a8917aab5ef7e8797f', 'request_id': 'req-b46d5afc-4f2c-4b01-94c8-8c153b740926'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.051669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea701672dbd47a8917aab5ef7e8797f', 'request_id': 'req-b46d5afc-4f2c-4b01-94c8-8c153b740926'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.076370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] The token cache is being invalidate because project dea701672dbd47a8917aab5ef7e8797f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:17.076925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.078695 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b46d5afc-4f2c-4b01-94c8-8c153b740926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.091410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1035/2088] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:16 2022] DELETE /identity/v3/projects/dea701672dbd47a8917aab5ef7e8797f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:17.096459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc2e33-e495-4e9c-b689-5790b8bb8d55 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.096826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc2e33-e495-4e9c-b689-5790b8bb8d55 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.097101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc2e33-e495-4e9c-b689-5790b8bb8d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.117564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-44dc2e33-e495-4e9c-b689-5790b8bb8d55 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:17.118800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-44dc2e33-e495-4e9c-b689-5790b8bb8d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:17.199945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1054/2089] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:17.207824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1390016-5e61-479a-9220-8da5b3d53d63 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.208089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1390016-5e61-479a-9220-8da5b3d53d63 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.208714 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1390016-5e61-479a-9220-8da5b3d53d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.235546 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a1390016-5e61-479a-9220-8da5b3d53d63 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:17.236922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a1390016-5e61-479a-9220-8da5b3d53d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:17.253863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc2e33-e495-4e9c-b689-5790b8bb8d55 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:17.259430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1036/2090] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:17.267692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc2e33-e495-4e9c-b689-5790b8bb8d55 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:17.274423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051fc4f-54d7-4789-8f6e-3d37f8db7157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:17.275108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051fc4f-54d7-4789-8f6e-3d37f8db7157 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.275392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051fc4f-54d7-4789-8f6e-3d37f8db7157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.275669 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051fc4f-54d7-4789-8f6e-3d37f8db7157 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.277357 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051fc4f-54d7-4789-8f6e-3d37f8db7157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:17.277676 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051fc4f-54d7-4789-8f6e-3d37f8db7157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:17.280322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051fc4f-54d7-4789-8f6e-3d37f8db7157 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:17.295330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1055/2091] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:17.298650 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1390016-5e61-479a-9220-8da5b3d53d63 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:17.311476 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1390016-5e61-479a-9220-8da5b3d53d63 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:17.317333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca00fa-f783-4aea-8733-5a4175df58bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:17.317987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca00fa-f783-4aea-8733-5a4175df58bf admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.318258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca00fa-f783-4aea-8733-5a4175df58bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.319441 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca00fa-f783-4aea-8733-5a4175df58bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.319441 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca00fa-f783-4aea-8733-5a4175df58bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:17.321510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca00fa-f783-4aea-8733-5a4175df58bf admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:17.355339 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1037/2092] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:17 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:17.359421 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051fc4f-54d7-4789-8f6e-3d37f8db7157 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:17.367064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca00fa-f783-4aea-8733-5a4175df58bf admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:17.368657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-10ca00fa-f783-4aea-8733-5a4175df58bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:17.382224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051fc4f-54d7-4789-8f6e-3d37f8db7157 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:17.484787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0608479-5c2c-4691-9959-c862a74795de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:17.486320 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0608479-5c2c-4691-9959-c862a74795de admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.487224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0608479-5c2c-4691-9959-c862a74795de admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.487882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0608479-5c2c-4691-9959-c862a74795de admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.489095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0608479-5c2c-4691-9959-c862a74795de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:17.491208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0608479-5c2c-4691-9959-c862a74795de admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:17.500403 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca00fa-f783-4aea-8733-5a4175df58bf admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:17.506563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:17.507928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.508621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.508905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] PATH_INFO: `/v3/projects/f8840d06a0454fa2b53a360075a94b32` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.510507 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8840d06a0454fa2b53a360075a94b32)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:17.513262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:17.520171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1056/2093] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:17 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:17.521414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0608479-5c2c-4691-9959-c862a74795de admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:17.523617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e0608479-5c2c-4691-9959-c862a74795de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:17.552405 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0608479-5c2c-4691-9959-c862a74795de admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:17.565145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:17.566019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.566300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.566573 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] PATH_INFO: `/v3/projects/92d6a65dac0741eeb1eb237f19ad8762` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.567808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d6a65dac0741eeb1eb237f19ad8762)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:17.569927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:17.638002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8840d06a0454fa2b53a360075a94b32', 'request_id': 'req-eaf548e8-985b-4825-8bb4-94b0a1375bb8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.644138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8840d06a0454fa2b53a360075a94b32', 'request_id': 'req-eaf548e8-985b-4825-8bb4-94b0a1375bb8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.650716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8840d06a0454fa2b53a360075a94b32', 'request_id': 'req-eaf548e8-985b-4825-8bb4-94b0a1375bb8'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.651084 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d6a65dac0741eeb1eb237f19ad8762', 'request_id': 'req-d7874b66-83e8-45d4-8496-bb753263ebf2'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.657462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d6a65dac0741eeb1eb237f19ad8762', 'request_id': 'req-d7874b66-83e8-45d4-8496-bb753263ebf2'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.666918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d6a65dac0741eeb1eb237f19ad8762', 'request_id': 'req-d7874b66-83e8-45d4-8496-bb753263ebf2'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.670634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] The token cache is being invalidate because project f8840d06a0454fa2b53a360075a94b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:17.671011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.671594 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.673960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1038/2094] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:17 2022] DELETE /identity/v3/projects/f8840d06a0454fa2b53a360075a94b32 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:17.677234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:17.679377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:17.682452 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] The token cache is being invalidate because project 92d6a65dac0741eeb1eb237f19ad8762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:17.682791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.684104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.686697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1057/2095] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:17 2022] DELETE /identity/v3/projects/92d6a65dac0741eeb1eb237f19ad8762 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:17.687500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:17.688786 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:17.751983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf548e8-985b-4825-8bb4-94b0a1375bb8 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:17.752255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7874b66-83e8-45d4-8496-bb753263ebf2 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:17.757330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:17.758129 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.758432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.758696 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] PATH_INFO: `/v3/users/79502f94104340b3a8508f1c33ec14a9` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.759485 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f986cd5-d02b-41d1-ad3c-dc2da8873469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:17.759932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79502f94104340b3a8508f1c33ec14a9)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:17.760317 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f986cd5-d02b-41d1-ad3c-dc2da8873469 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.760602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f986cd5-d02b-41d1-ad3c-dc2da8873469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.760922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f986cd5-d02b-41d1-ad3c-dc2da8873469 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.761709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f986cd5-d02b-41d1-ad3c-dc2da8873469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:17.761935 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:17.763961 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f986cd5-d02b-41d1-ad3c-dc2da8873469 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:17.774365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1039/2096] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:17.776521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ca234-02c3-4ddc-a4e8-1a6372d67a76 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.776842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ca234-02c3-4ddc-a4e8-1a6372d67a76 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.777205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ca234-02c3-4ddc-a4e8-1a6372d67a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.795290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e81ca234-02c3-4ddc-a4e8-1a6372d67a76 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:17.796535 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e81ca234-02c3-4ddc-a4e8-1a6372d67a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:17.811882 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1040/2097] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:17.811882 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ca234-02c3-4ddc-a4e8-1a6372d67a76 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:17.813681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e81ca234-02c3-4ddc-a4e8-1a6372d67a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:17.819356 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79502f94104340b3a8508f1c33ec14a9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.820462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79502f94104340b3a8508f1c33ec14a9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.821452 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79502f94104340b3a8508f1c33ec14a9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.826798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ca234-02c3-4ddc-a4e8-1a6372d67a76 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:17.832800 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc6404-0c8c-4066-bc8d-94fc2a549fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:17.833778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6404-0c8c-4066-bc8d-94fc2a549fce admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.834070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6404-0c8c-4066-bc8d-94fc2a549fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.834374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6404-0c8c-4066-bc8d-94fc2a549fce admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.835380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc6404-0c8c-4066-bc8d-94fc2a549fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:17.836066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79502f94104340b3a8508f1c33ec14a9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.836975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc6404-0c8c-4066-bc8d-94fc2a549fce admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:17.844803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79502f94104340b3a8508f1c33ec14a9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:17.852186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1041/2098] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:17.853886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c825-73bb-42c4-b71c-a77abb4a9c10 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.854320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c825-73bb-42c4-b71c-a77abb4a9c10 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.854799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c825-73bb-42c4-b71c-a77abb4a9c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.864808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1058/2099] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:17 2022] DELETE /identity/v3/users/79502f94104340b3a8508f1c33ec14a9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:17.865876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:17.867331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:17.886301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c1a0c825-73bb-42c4-b71c-a77abb4a9c10 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:17.888972 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c1a0c825-73bb-42c4-b71c-a77abb4a9c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:17.959091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a2546-339a-4f07-af95-f66a0d893b98 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:17.964983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81c11f-ff7f-4965-a701-c64b83c9f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:17.966390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81c11f-ff7f-4965-a701-c64b83c9f4d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.966933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81c11f-ff7f-4965-a701-c64b83c9f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.967499 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81c11f-ff7f-4965-a701-c64b83c9f4d2 admin admin] PATH_INFO: `/v3/projects/26433fef4ff04344adb7ef1bd9e66e42/users/d6c47ee411fd43849fe6475daaa431fd/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.972576 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1042/2100] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:17.976933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48147df8-3fac-405d-a9bb-dc0e00cfe180 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:17.977290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48147df8-3fac-405d-a9bb-dc0e00cfe180 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:17.977699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48147df8-3fac-405d-a9bb-dc0e00cfe180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:17.986016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81c11f-ff7f-4965-a701-c64b83c9f4d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26433fef4ff04344adb7ef1bd9e66e42, user_id=d6c47ee411fd43849fe6475daaa431fd, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:17.988720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81c11f-ff7f-4965-a701-c64b83c9f4d2 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.007725 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-48147df8-3fac-405d-a9bb-dc0e00cfe180 None None] MFA Rules not processed for user `2d4da73ac92b47f4b9d4b393dea47d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:18.008846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-48147df8-3fac-405d-a9bb-dc0e00cfe180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:18.015128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1059/2101] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:17 2022] PUT /identity/v3/projects/26433fef4ff04344adb7ef1bd9e66e42/users/d6c47ee411fd43849fe6475daaa431fd/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:18.016076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81c11f-ff7f-4965-a701-c64b83c9f4d2 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.094590 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1043/2102] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:18.095133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81c11f-ff7f-4965-a701-c64b83c9f4d2 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:18.096079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c356c64-cd7f-4c95-9abd-906c6317d515 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.096368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c356c64-cd7f-4c95-9abd-906c6317d515 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.096638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c356c64-cd7f-4c95-9abd-906c6317d515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.101316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727a4d2-23c9-40cc-b6dc-a03be4ab812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:18.102010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a4d2-23c9-40cc-b6dc-a03be4ab812f admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.102290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a4d2-23c9-40cc-b6dc-a03be4ab812f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.102560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a4d2-23c9-40cc-b6dc-a03be4ab812f admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.103362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727a4d2-23c9-40cc-b6dc-a03be4ab812f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:18.103718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727a4d2-23c9-40cc-b6dc-a03be4ab812f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:18.106233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727a4d2-23c9-40cc-b6dc-a03be4ab812f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.125286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1060/2103] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:18.126481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727a4d2-23c9-40cc-b6dc-a03be4ab812f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.130213 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-7c356c64-cd7f-4c95-9abd-906c6317d515 None None] MFA Rules not processed for user `d6c47ee411fd43849fe6475daaa431fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:18.131447 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7c356c64-cd7f-4c95-9abd-906c6317d515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:18.139730 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727a4d2-23c9-40cc-b6dc-a03be4ab812f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:18.146578 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155916e-5c30-4aa4-9f0c-779384c242ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:18.147361 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155916e-5c30-4aa4-9f0c-779384c242ae admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.147649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155916e-5c30-4aa4-9f0c-779384c242ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.148094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155916e-5c30-4aa4-9f0c-779384c242ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.149038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155916e-5c30-4aa4-9f0c-779384c242ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:18.151322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155916e-5c30-4aa4-9f0c-779384c242ae admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.200482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1061/2104] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:18 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:18.204557 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155916e-5c30-4aa4-9f0c-779384c242ae admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.212523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1044/2105] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:18.224432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c356c64-cd7f-4c95-9abd-906c6317d515 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.226308 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7c356c64-cd7f-4c95-9abd-906c6317d515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:18.290605 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155916e-5c30-4aa4-9f0c-779384c242ae admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:18.301039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c356c64-cd7f-4c95-9abd-906c6317d515 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:18.311983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7698935-da8f-4184-8f07-72ec2842034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:18.312849 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7698935-da8f-4184-8f07-72ec2842034e admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.313423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7698935-da8f-4184-8f07-72ec2842034e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.313729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7698935-da8f-4184-8f07-72ec2842034e admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.314535 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7698935-da8f-4184-8f07-72ec2842034e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:18.318373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7698935-da8f-4184-8f07-72ec2842034e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.344615 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1062/2106] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:18 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:18.346000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7698935-da8f-4184-8f07-72ec2842034e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.349610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c7698935-da8f-4184-8f07-72ec2842034e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:18.362666 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7698935-da8f-4184-8f07-72ec2842034e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:18.373062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:18.373925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.374232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.374471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] PATH_INFO: `/v3/projects/2f828dfd8f6e492fbf9d4ebcd25a610c` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.375865 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f828dfd8f6e492fbf9d4ebcd25a610c)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:18.378255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.381850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a10cb0-dd24-4d09-aaeb-bf70597ca4b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ad61a348b2450baceb030f98150647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:18.382722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10cb0-dd24-4d09-aaeb-bf70597ca4b7 service glance] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.385649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10cb0-dd24-4d09-aaeb-bf70597ca4b7 service glance] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.385997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10cb0-dd24-4d09-aaeb-bf70597ca4b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.432375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f828dfd8f6e492fbf9d4ebcd25a610c', 'request_id': 'req-5bc13a65-31fd-44f9-a990-7ba57a676832'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:18.438812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f828dfd8f6e492fbf9d4ebcd25a610c', 'request_id': 'req-5bc13a65-31fd-44f9-a990-7ba57a676832'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:18.445981 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f828dfd8f6e492fbf9d4ebcd25a610c', 'request_id': 'req-5bc13a65-31fd-44f9-a990-7ba57a676832'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:18.464240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] The token cache is being invalidate because project 2f828dfd8f6e492fbf9d4ebcd25a610c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:18.464624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:18.465353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:18.467820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1063/2107] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:18 2022] DELETE /identity/v3/projects/2f828dfd8f6e492fbf9d4ebcd25a610c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:18.471124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a10cb0-dd24-4d09-aaeb-bf70597ca4b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:18.471295 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.472504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a10cb0-dd24-4d09-aaeb-bf70597ca4b7 service glance] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.473186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:18.483892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1045/2108] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:18.485601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718bfe1-6114-43c1-88da-e81bbac6b06a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.485902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718bfe1-6114-43c1-88da-e81bbac6b06a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.486174 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718bfe1-6114-43c1-88da-e81bbac6b06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.509102 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-6718bfe1-6114-43c1-88da-e81bbac6b06a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:18.510380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6718bfe1-6114-43c1-88da-e81bbac6b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:18.554041 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc13a65-31fd-44f9-a990-7ba57a676832 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:18.560913 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b025e0-6c30-40c8-9f3c-f91602e72920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:18.561914 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b025e0-6c30-40c8-9f3c-f91602e72920 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.562364 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b025e0-6c30-40c8-9f3c-f91602e72920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.562936 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b025e0-6c30-40c8-9f3c-f91602e72920 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.563994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b025e0-6c30-40c8-9f3c-f91602e72920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:18.565956 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b025e0-6c30-40c8-9f3c-f91602e72920 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.577469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1064/2109] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:18.581866 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b025e0-6c30-40c8-9f3c-f91602e72920 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.605415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1046/2110] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:18.615558 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f07bd6-9b91-41f3-adbb-319b581207d4 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.616104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f07bd6-9b91-41f3-adbb-319b581207d4 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.616453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f07bd6-9b91-41f3-adbb-319b581207d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.629232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b025e0-6c30-40c8-9f3c-f91602e72920 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:18.646079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc30699-7ffe-4b3d-9198-0daa93041d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:18.646627 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30699-7ffe-4b3d-9198-0daa93041d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.646943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30699-7ffe-4b3d-9198-0daa93041d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.647375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30699-7ffe-4b3d-9198-0daa93041d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.648117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc30699-7ffe-4b3d-9198-0daa93041d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:18.648983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-23f07bd6-9b91-41f3-adbb-319b581207d4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:18.650449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc30699-7ffe-4b3d-9198-0daa93041d02 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.650868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-23f07bd6-9b91-41f3-adbb-319b581207d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:18.660477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1047/2111] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:18.665506 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f07bd6-9b91-41f3-adbb-319b581207d4 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.677067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1065/2112] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:18.677778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f07bd6-9b91-41f3-adbb-319b581207d4 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:18.678829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc30699-7ffe-4b3d-9198-0daa93041d02 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.685244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477cd28-42aa-414f-9a18-7ae6596c8f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:18.686005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477cd28-42aa-414f-9a18-7ae6596c8f88 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.686378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477cd28-42aa-414f-9a18-7ae6596c8f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.687140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477cd28-42aa-414f-9a18-7ae6596c8f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.687973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477cd28-42aa-414f-9a18-7ae6596c8f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:18.689628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477cd28-42aa-414f-9a18-7ae6596c8f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:18.691616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477cd28-42aa-414f-9a18-7ae6596c8f88 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.710690 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1048/2113] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:18.711858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477cd28-42aa-414f-9a18-7ae6596c8f88 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.712956 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc30699-7ffe-4b3d-9198-0daa93041d02 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:18.725268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab1fe2-447d-445c-9731-5c51f5161789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:18.725619 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477cd28-42aa-414f-9a18-7ae6596c8f88 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:18.726568 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab1fe2-447d-445c-9731-5c51f5161789 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.727155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab1fe2-447d-445c-9731-5c51f5161789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.727607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab1fe2-447d-445c-9731-5c51f5161789 admin admin] PATH_INFO: `/v3/projects/abde97fda30e4f5098ad568039fba367/users/86969d6d4cfc4b969552a4a07112d591/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.742756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6860c3-5d20-4e3c-886e-030d51820525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:18.743991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6860c3-5d20-4e3c-886e-030d51820525 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.746454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab1fe2-447d-445c-9731-5c51f5161789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abde97fda30e4f5098ad568039fba367, user_id=86969d6d4cfc4b969552a4a07112d591, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:18.746586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6860c3-5d20-4e3c-886e-030d51820525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.746876 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6860c3-5d20-4e3c-886e-030d51820525 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.747626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6860c3-5d20-4e3c-886e-030d51820525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:18.749517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab1fe2-447d-445c-9731-5c51f5161789 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.750127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6860c3-5d20-4e3c-886e-030d51820525 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.790950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1066/2114] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:18 2022] PUT /identity/v3/projects/abde97fda30e4f5098ad568039fba367/users/86969d6d4cfc4b969552a4a07112d591/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:18.792991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1049/2115] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:18 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:18.796807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6860c3-5d20-4e3c-886e-030d51820525 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.797636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5376f5-853c-49be-99d0-ee130dbc6006 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.797929 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5376f5-853c-49be-99d0-ee130dbc6006 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.798204 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5376f5-853c-49be-99d0-ee130dbc6006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.828506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6f5376f5-853c-49be-99d0-ee130dbc6006 None None] MFA Rules not processed for user `86969d6d4cfc4b969552a4a07112d591`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:18.829761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6f5376f5-853c-49be-99d0-ee130dbc6006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:18.906300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6860c3-5d20-4e3c-886e-030d51820525 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:18.911890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18511b26-d205-4d92-88a9-0f4670bc7461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:18.912703 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18511b26-d205-4d92-88a9-0f4670bc7461 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:18.913087 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18511b26-d205-4d92-88a9-0f4670bc7461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:18.913461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18511b26-d205-4d92-88a9-0f4670bc7461 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:18.914485 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1067/2116] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:18.925538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18511b26-d205-4d92-88a9-0f4670bc7461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:18.926478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5376f5-853c-49be-99d0-ee130dbc6006 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:18.928019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6f5376f5-853c-49be-99d0-ee130dbc6006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:18.931906 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18511b26-d205-4d92-88a9-0f4670bc7461 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:18.974660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1050/2117] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:18 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:18.976077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18511b26-d205-4d92-88a9-0f4670bc7461 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:19.004375 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18511b26-d205-4d92-88a9-0f4670bc7461 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.013484 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11aeea-e6f6-47f4-870a-bd72778ceafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.014296 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11aeea-e6f6-47f4-870a-bd72778ceafe admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.014746 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11aeea-e6f6-47f4-870a-bd72778ceafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.015256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11aeea-e6f6-47f4-870a-bd72778ceafe admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.015992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11aeea-e6f6-47f4-870a-bd72778ceafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.018027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11aeea-e6f6-47f4-870a-bd72778ceafe admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:19.028706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5376f5-853c-49be-99d0-ee130dbc6006 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.037769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1051/2118] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:19.041181 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11aeea-e6f6-47f4-870a-bd72778ceafe admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:19.042138 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ad4c1-e941-4418-9efa-69314a4e246e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.043418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ad4c1-e941-4418-9efa-69314a4e246e service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.043703 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ad4c1-e941-4418-9efa-69314a4e246e service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.043973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ad4c1-e941-4418-9efa-69314a4e246e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.064322 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11aeea-e6f6-47f4-870a-bd72778ceafe admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.071809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ad4c1-e941-4418-9efa-69314a4e246e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.073396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ad4c1-e941-4418-9efa-69314a4e246e service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:19.087020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f7068-78bc-4643-b606-278cf1843616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.088000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f7068-78bc-4643-b606-278cf1843616 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.088491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f7068-78bc-4643-b606-278cf1843616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.089621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f7068-78bc-4643-b606-278cf1843616 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.090575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f7068-78bc-4643-b606-278cf1843616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.092447 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f7068-78bc-4643-b606-278cf1843616 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:19.104461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1052/2119] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:19.108582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1068/2120] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:19.112655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f7068-78bc-4643-b606-278cf1843616 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:19.125287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f7068-78bc-4643-b606-278cf1843616 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.133659 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1363f52-f4e1-4f37-a567-5955cf6e612c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.134360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ad4c1-e941-4418-9efa-69314a4e246e service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:19.134584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1363f52-f4e1-4f37-a567-5955cf6e612c admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.134870 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1363f52-f4e1-4f37-a567-5955cf6e612c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.135152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1363f52-f4e1-4f37-a567-5955cf6e612c admin admin] PATH_INFO: `/v3/projects/0f3e066213d24253a1fa4569be27bc3a/users/a73b5ea81d1942c895598ed576133e0f/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.150940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ad4c1-e941-4418-9efa-69314a4e246e service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.160315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1363f52-f4e1-4f37-a567-5955cf6e612c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3e066213d24253a1fa4569be27bc3a, user_id=a73b5ea81d1942c895598ed576133e0f, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.165384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1363f52-f4e1-4f37-a567-5955cf6e612c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:19.175428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f4c22-1bca-490b-8a0f-43f4da9f02ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.176323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4c22-1bca-490b-8a0f-43f4da9f02ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.176603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4c22-1bca-490b-8a0f-43f4da9f02ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.177201 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4c22-1bca-490b-8a0f-43f4da9f02ba admin admin] PATH_INFO: `/v3/users/86969d6d4cfc4b969552a4a07112d591` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.185031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f4c22-1bca-490b-8a0f-43f4da9f02ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=86969d6d4cfc4b969552a4a07112d591)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.187145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f4c22-1bca-490b-8a0f-43f4da9f02ba admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:19.187839 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1053/2121] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:19 2022] PUT /identity/v3/projects/0f3e066213d24253a1fa4569be27bc3a/users/a73b5ea81d1942c895598ed576133e0f/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:19.200963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d688b7d-0d40-43bb-bfc7-8ca0609739fb None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.202106 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d688b7d-0d40-43bb-bfc7-8ca0609739fb None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.202455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d688b7d-0d40-43bb-bfc7-8ca0609739fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.253536 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-9d688b7d-0d40-43bb-bfc7-8ca0609739fb None None] MFA Rules not processed for user `a73b5ea81d1942c895598ed576133e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:19.255093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9d688b7d-0d40-43bb-bfc7-8ca0609739fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:19.299153 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f86f4c22-1bca-490b-8a0f-43f4da9f02ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86969d6d4cfc4b969552a4a07112d591'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:19.299974 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f86f4c22-1bca-490b-8a0f-43f4da9f02ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86969d6d4cfc4b969552a4a07112d591'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:19.301323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f86f4c22-1bca-490b-8a0f-43f4da9f02ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86969d6d4cfc4b969552a4a07112d591'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:19.328851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f86f4c22-1bca-490b-8a0f-43f4da9f02ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86969d6d4cfc4b969552a4a07112d591'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:19.336965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1054/2122] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:19.342173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d688b7d-0d40-43bb-bfc7-8ca0609739fb None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:19.342615 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f86f4c22-1bca-490b-8a0f-43f4da9f02ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86969d6d4cfc4b969552a4a07112d591'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:19.343696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9d688b7d-0d40-43bb-bfc7-8ca0609739fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:19.358233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1069/2123] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:19 2022] DELETE /identity/v3/users/86969d6d4cfc4b969552a4a07112d591 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:19.363678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3936cc8-1b36-4d06-9e1a-e495400fe0ef None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.364035 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3936cc8-1b36-4d06-9e1a-e495400fe0ef None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.364322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3936cc8-1b36-4d06-9e1a-e495400fe0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.383846 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-d3936cc8-1b36-4d06-9e1a-e495400fe0ef None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:19.385039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d3936cc8-1b36-4d06-9e1a-e495400fe0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:19.416936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d688b7d-0d40-43bb-bfc7-8ca0609739fb None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.454335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1070/2124] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:19.467368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3936cc8-1b36-4d06-9e1a-e495400fe0ef None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:19.468909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d3936cc8-1b36-4d06-9e1a-e495400fe0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:19.484334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7b5b-1d85-4dba-8f88-3b4586061204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.485018 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7b5b-1d85-4dba-8f88-3b4586061204 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.485288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7b5b-1d85-4dba-8f88-3b4586061204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.485527 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7b5b-1d85-4dba-8f88-3b4586061204 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.486218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed7b5b-1d85-4dba-8f88-3b4586061204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.488145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed7b5b-1d85-4dba-8f88-3b4586061204 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:19.518938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1055/2125] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:19 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:19.522002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7b5b-1d85-4dba-8f88-3b4586061204 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:19.540998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3936cc8-1b36-4d06-9e1a-e495400fe0ef None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.600581 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fdffb-30bc-45c0-ba7a-635b5c02e0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.601233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fdffb-30bc-45c0-ba7a-635b5c02e0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.601511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fdffb-30bc-45c0-ba7a-635b5c02e0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.601782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fdffb-30bc-45c0-ba7a-635b5c02e0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.603119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7b5b-1d85-4dba-8f88-3b4586061204 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.609563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f661ecf-a9d3-4450-958d-5b44593a6a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.610383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f661ecf-a9d3-4450-958d-5b44593a6a3d admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.611084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f661ecf-a9d3-4450-958d-5b44593a6a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.611369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f661ecf-a9d3-4450-958d-5b44593a6a3d admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.611880 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fdffb-30bc-45c0-ba7a-635b5c02e0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.612289 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f661ecf-a9d3-4450-958d-5b44593a6a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.613331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fdffb-30bc-45c0-ba7a-635b5c02e0d7 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:19.615275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f661ecf-a9d3-4450-958d-5b44593a6a3d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:19.623484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1071/2126] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:19.639590 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1056/2127] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:19 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:19.644027 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fdffb-30bc-45c0-ba7a-635b5c02e0d7 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:19.655991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fdffb-30bc-45c0-ba7a-635b5c02e0d7 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.661556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202617-a1a6-4ccc-9ab6-46f751346fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.662214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202617-a1a6-4ccc-9ab6-46f751346fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.662492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202617-a1a6-4ccc-9ab6-46f751346fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.662760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202617-a1a6-4ccc-9ab6-46f751346fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.663501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202617-a1a6-4ccc-9ab6-46f751346fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.665133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202617-a1a6-4ccc-9ab6-46f751346fc2 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:19.675887 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1072/2128] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:19.679866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f661ecf-a9d3-4450-958d-5b44593a6a3d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:19.690036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f661ecf-a9d3-4450-958d-5b44593a6a3d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.696992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e488af-6bcd-4961-bf82-25feb6b446be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.700093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e488af-6bcd-4961-bf82-25feb6b446be admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.700377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e488af-6bcd-4961-bf82-25feb6b446be admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.700651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e488af-6bcd-4961-bf82-25feb6b446be admin admin] PATH_INFO: `/v3/projects/b488c6e659ae49ab8708d4496979ce78/users/5c3edc9b7f964530bdae4910bd98a7a1/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.741924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e488af-6bcd-4961-bf82-25feb6b446be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b488c6e659ae49ab8708d4496979ce78, user_id=5c3edc9b7f964530bdae4910bd98a7a1, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.747314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e488af-6bcd-4961-bf82-25feb6b446be admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:19.787463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1057/2129] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:19 2022] PUT /identity/v3/projects/b488c6e659ae49ab8708d4496979ce78/users/5c3edc9b7f964530bdae4910bd98a7a1/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:19.793456 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202617-a1a6-4ccc-9ab6-46f751346fc2 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:19.823187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202617-a1a6-4ccc-9ab6-46f751346fc2 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.914087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6933abd-c66c-46dd-9d43-059106c48297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.915623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6933abd-c66c-46dd-9d43-059106c48297 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.915979 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6933abd-c66c-46dd-9d43-059106c48297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.916330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6933abd-c66c-46dd-9d43-059106c48297 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.917950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6933abd-c66c-46dd-9d43-059106c48297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.919362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6933abd-c66c-46dd-9d43-059106c48297 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:19.939357 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1073/2130] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:19.943657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e488af-6bcd-4961-bf82-25feb6b446be admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:19.974854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e488af-6bcd-4961-bf82-25feb6b446be admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:19.982552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0c935-5aa2-498b-a398-d0fae727fe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:19.983708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c935-5aa2-498b-a398-d0fae727fe14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:19.984040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c935-5aa2-498b-a398-d0fae727fe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:19.984311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c935-5aa2-498b-a398-d0fae727fe14 admin admin] PATH_INFO: `/v3/projects/b488c6e659ae49ab8708d4496979ce78/users/5c3edc9b7f964530bdae4910bd98a7a1/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:19.990936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0c935-5aa2-498b-a398-d0fae727fe14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b488c6e659ae49ab8708d4496979ce78, user_id=5c3edc9b7f964530bdae4910bd98a7a1, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:19.995020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0c935-5aa2-498b-a398-d0fae727fe14 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:20.013600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1058/2131] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:19 2022] PUT /identity/v3/projects/b488c6e659ae49ab8708d4496979ce78/users/5c3edc9b7f964530bdae4910bd98a7a1/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:20.026163 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc857fb-6d8b-44f6-91fb-f04aed8bff89 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.026480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc857fb-6d8b-44f6-91fb-f04aed8bff89 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.027254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc857fb-6d8b-44f6-91fb-f04aed8bff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.072647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0c935-5aa2-498b-a398-d0fae727fe14 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:20.076676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-4fe0c935-5aa2-498b-a398-d0fae727fe14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:20.089396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-5fc857fb-6d8b-44f6-91fb-f04aed8bff89 None None] MFA Rules not processed for user `5c3edc9b7f964530bdae4910bd98a7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:20.092524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5fc857fb-6d8b-44f6-91fb-f04aed8bff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:20.191284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1074/2132] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:20.200245 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0c935-5aa2-498b-a398-d0fae727fe14 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:20.211902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:20.212851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.213134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.213383 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc857fb-6d8b-44f6-91fb-f04aed8bff89 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:20.213502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] PATH_INFO: `/v3/projects/abde97fda30e4f5098ad568039fba367` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.214793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=abde97fda30e4f5098ad568039fba367)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:20.215462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5fc857fb-6d8b-44f6-91fb-f04aed8bff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:20.216924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:20.293512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abde97fda30e4f5098ad568039fba367', 'request_id': 'req-1545965c-64d2-4ed3-b859-40d07bbe8b4f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:20.301557 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abde97fda30e4f5098ad568039fba367', 'request_id': 'req-1545965c-64d2-4ed3-b859-40d07bbe8b4f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:20.308904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abde97fda30e4f5098ad568039fba367', 'request_id': 'req-1545965c-64d2-4ed3-b859-40d07bbe8b4f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:20.323505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] The token cache is being invalidate because project abde97fda30e4f5098ad568039fba367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:20.323941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:20.324653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1545965c-64d2-4ed3-b859-40d07bbe8b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:20.335959 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1059/2133] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:20 2022] DELETE /identity/v3/projects/abde97fda30e4f5098ad568039fba367 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:20.341017 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc857fb-6d8b-44f6-91fb-f04aed8bff89 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:20.341720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d350-289a-4b8a-9be5-dd6b2a7ed5f6 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.342011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d350-289a-4b8a-9be5-dd6b2a7ed5f6 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.342404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d350-289a-4b8a-9be5-dd6b2a7ed5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.366929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-21d8d350-289a-4b8a-9be5-dd6b2a7ed5f6 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:20.368156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-21d8d350-289a-4b8a-9be5-dd6b2a7ed5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:20.411314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e031630-6490-44a6-9778-272066eacd15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:20.412059 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e031630-6490-44a6-9778-272066eacd15 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.412415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e031630-6490-44a6-9778-272066eacd15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.412755 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e031630-6490-44a6-9778-272066eacd15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.414560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6e031630-6490-44a6-9778-272066eacd15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:20.429657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1060/2134] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:20.438738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e167-6541-4e0a-b1d6-b5a0a558fc43 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.439065 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e167-6541-4e0a-b1d6-b5a0a558fc43 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.439339 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e167-6541-4e0a-b1d6-b5a0a558fc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.457085 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ea86e167-6541-4e0a-b1d6-b5a0a558fc43 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:20.458436 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ea86e167-6541-4e0a-b1d6-b5a0a558fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:20.476296 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1061/2135] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:20.480959 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86e167-6541-4e0a-b1d6-b5a0a558fc43 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:20.483993 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e031630-6490-44a6-9778-272066eacd15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:20.485468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e031630-6490-44a6-9778-272066eacd15 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:20.492910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86e167-6541-4e0a-b1d6-b5a0a558fc43 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:20.497962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1075/2136] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:20.500146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d6c1e-204f-4207-b36b-55336574e817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:20.500811 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6c1e-204f-4207-b36b-55336574e817 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.501088 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6c1e-204f-4207-b36b-55336574e817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.501409 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6c1e-204f-4207-b36b-55336574e817 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.502132 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d6c1e-204f-4207-b36b-55336574e817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:20.502429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d6c1e-204f-4207-b36b-55336574e817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:20.504149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d6c1e-204f-4207-b36b-55336574e817 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:20.520405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1062/2137] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:39:20.525048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e031630-6490-44a6-9778-272066eacd15 service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:20.536998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e031630-6490-44a6-9778-272066eacd15 service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:20.543053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5638b-1d43-4ae6-abb1-7f3f9b5db80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:20.543728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5638b-1d43-4ae6-abb1-7f3f9b5db80d admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.544010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5638b-1d43-4ae6-abb1-7f3f9b5db80d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.544287 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5638b-1d43-4ae6-abb1-7f3f9b5db80d admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.544995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5638b-1d43-4ae6-abb1-7f3f9b5db80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:20.546984 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5638b-1d43-4ae6-abb1-7f3f9b5db80d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:20.575027 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1076/2138] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:20 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:20.578778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d6c1e-204f-4207-b36b-55336574e817 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:20.602710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d6c1e-204f-4207-b36b-55336574e817 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:20.676217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6094d8-4af2-4c48-bad3-977a413df359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:20.677011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6094d8-4af2-4c48-bad3-977a413df359 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.677383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6094d8-4af2-4c48-bad3-977a413df359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.677726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6094d8-4af2-4c48-bad3-977a413df359 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.678509 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6094d8-4af2-4c48-bad3-977a413df359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:20.680515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6094d8-4af2-4c48-bad3-977a413df359 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:20.706949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1063/2139] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:20 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:20.709425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5638b-1d43-4ae6-abb1-7f3f9b5db80d admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:20.721010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5638b-1d43-4ae6-abb1-7f3f9b5db80d admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:20.727541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492dc91-792e-4fc0-b184-9152c29fef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:20.728287 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492dc91-792e-4fc0-b184-9152c29fef3f admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.728640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492dc91-792e-4fc0-b184-9152c29fef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.728977 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492dc91-792e-4fc0-b184-9152c29fef3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.730311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492dc91-792e-4fc0-b184-9152c29fef3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:20.732370 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492dc91-792e-4fc0-b184-9152c29fef3f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:20.750951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1077/2140] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:20.751941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6094d8-4af2-4c48-bad3-977a413df359 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:20.764898 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6094d8-4af2-4c48-bad3-977a413df359 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:20.771055 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31484327-41c4-4041-8726-03029c0e5a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:20.771717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31484327-41c4-4041-8726-03029c0e5a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.772000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31484327-41c4-4041-8726-03029c0e5a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.772274 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31484327-41c4-4041-8726-03029c0e5a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.773234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31484327-41c4-4041-8726-03029c0e5a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:20.775452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31484327-41c4-4041-8726-03029c0e5a90 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:20.787885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1064/2141] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:20.793622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492dc91-792e-4fc0-b184-9152c29fef3f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:20.804592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492dc91-792e-4fc0-b184-9152c29fef3f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:20.809984 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea77e0-6fa7-4c41-ad35-4623eb450fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:20.810896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea77e0-6fa7-4c41-ad35-4623eb450fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.811216 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea77e0-6fa7-4c41-ad35-4623eb450fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.811612 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea77e0-6fa7-4c41-ad35-4623eb450fd6 admin admin] PATH_INFO: `/v3/projects/16f2cdbdf08242f1ba83a74a33b2a1d9/users/82eb1486d8a2400fbd91450e36974401/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.826610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea77e0-6fa7-4c41-ad35-4623eb450fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f2cdbdf08242f1ba83a74a33b2a1d9, user_id=82eb1486d8a2400fbd91450e36974401, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:20.831919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea77e0-6fa7-4c41-ad35-4623eb450fd6 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:20.848045 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1078/2142] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:20 2022] PUT /identity/v3/projects/16f2cdbdf08242f1ba83a74a33b2a1d9/users/82eb1486d8a2400fbd91450e36974401/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:20.859182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f1256-9c00-4f06-b013-2b488842b38b None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.859448 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f1256-9c00-4f06-b013-2b488842b38b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.859723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f1256-9c00-4f06-b013-2b488842b38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.879071 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea77e0-6fa7-4c41-ad35-4623eb450fd6 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:20.908749 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-5a9f1256-9c00-4f06-b013-2b488842b38b None None] MFA Rules not processed for user `82eb1486d8a2400fbd91450e36974401`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:20.910424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5a9f1256-9c00-4f06-b013-2b488842b38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:20.973122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea77e0-6fa7-4c41-ad35-4623eb450fd6 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:20.980785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ee0d-e7d9-458b-b6e2-a8ef3e16d552 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3edc9b7f964530bdae4910bd98a7a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b488c6e659ae49ab8708d4496979ce78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:20.981551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ee0d-e7d9-458b-b6e2-a8ef3e16d552 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:20.982178 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ee0d-e7d9-458b-b6e2-a8ef3e16d552 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:20.982529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ee0d-e7d9-458b-b6e2-a8ef3e16d552 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:20.983372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02ee0d-e7d9-458b-b6e2-a8ef3e16d552 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:20.983749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02ee0d-e7d9-458b-b6e2-a8ef3e16d552 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:20.986356 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02ee0d-e7d9-458b-b6e2-a8ef3e16d552 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:21.005118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1065/2143] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:21.005664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1079/2144] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:39:21.010836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f1256-9c00-4f06-b013-2b488842b38b None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:21.017360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ee0d-e7d9-458b-b6e2-a8ef3e16d552 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:21.020209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6b02ee0d-e7d9-458b-b6e2-a8ef3e16d552 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:21.025161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f1256-9c00-4f06-b013-2b488842b38b None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:21.041285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ff96b-c191-4d67-a7da-bb550bb1491e tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3edc9b7f964530bdae4910bd98a7a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b488c6e659ae49ab8708d4496979ce78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:21.042934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ff96b-c191-4d67-a7da-bb550bb1491e tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:21.043670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ff96b-c191-4d67-a7da-bb550bb1491e tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:21.043825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ff96b-c191-4d67-a7da-bb550bb1491e tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:21.045431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ff96b-c191-4d67-a7da-bb550bb1491e tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:21.047720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ff96b-c191-4d67-a7da-bb550bb1491e tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:21.118455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1066/2145] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:21 2022] POST /identity/v3/projects => generated 352 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:21.120003 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ee0d-e7d9-458b-b6e2-a8ef3e16d552 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:21.120271 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ff96b-c191-4d67-a7da-bb550bb1491e tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:21.225534 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ff96b-c191-4d67-a7da-bb550bb1491e tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:21.234155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031485c-08b8-4458-8228-1f8dd988d47b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:21.234869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031485c-08b8-4458-8228-1f8dd988d47b service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:21.235043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f4bef-7f99-4be8-be9c-55ce5a6e66c8 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3edc9b7f964530bdae4910bd98a7a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b488c6e659ae49ab8708d4496979ce78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:21.235182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031485c-08b8-4458-8228-1f8dd988d47b service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:21.235464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031485c-08b8-4458-8228-1f8dd988d47b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:21.235933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f4bef-7f99-4be8-be9c-55ce5a6e66c8 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:21.244864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f4bef-7f99-4be8-be9c-55ce5a6e66c8 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:21.245338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f4bef-7f99-4be8-be9c-55ce5a6e66c8 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:21.247815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f4bef-7f99-4be8-be9c-55ce5a6e66c8 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:21.249659 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f4bef-7f99-4be8-be9c-55ce5a6e66c8 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:21.252975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f4bef-7f99-4be8-be9c-55ce5a6e66c8 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:21.282890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1067/2146] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:21.340331 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f4bef-7f99-4be8-be9c-55ce5a6e66c8 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:21.367667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f4bef-7f99-4be8-be9c-55ce5a6e66c8 tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:21.369956 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031485c-08b8-4458-8228-1f8dd988d47b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:21.372718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031485c-08b8-4458-8228-1f8dd988d47b service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:21.387705 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3edc9b7f964530bdae4910bd98a7a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b488c6e659ae49ab8708d4496979ce78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:21.388589 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:21.388875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:21.389148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] PATH_INFO: `/v3/projects/9c721691ea1d4265b11559005794a416` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:21.392064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c721691ea1d4265b11559005794a416)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:21.393417 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1080/2147] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:21.412360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:21.413878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031485c-08b8-4458-8228-1f8dd988d47b service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:21.487999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c721691ea1d4265b11559005794a416', 'request_id': 'req-378769a6-6d8c-495c-9e5f-a614bde2db5c'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.494993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c721691ea1d4265b11559005794a416', 'request_id': 'req-378769a6-6d8c-495c-9e5f-a614bde2db5c'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.502877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c721691ea1d4265b11559005794a416', 'request_id': 'req-378769a6-6d8c-495c-9e5f-a614bde2db5c'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.503486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031485c-08b8-4458-8228-1f8dd988d47b service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:21.532148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] The token cache is being invalidate because project 9c721691ea1d4265b11559005794a416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:21.532710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.533650 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-378769a6-6d8c-495c-9e5f-a614bde2db5c tempest-VolumeQuotaClassesTest-1262757029 tempest-VolumeQuotaClassesTest-1262757029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.544698 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1068/2148] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:21 2022] DELETE /identity/v3/projects/9c721691ea1d4265b11559005794a416 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:21.574667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:21.575816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:21.576345 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:21.576693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] PATH_INFO: `/v3/users/82eb1486d8a2400fbd91450e36974401` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:21.578131 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=82eb1486d8a2400fbd91450e36974401)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:21.580124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:21.655126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82eb1486d8a2400fbd91450e36974401'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.655851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82eb1486d8a2400fbd91450e36974401'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.656757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82eb1486d8a2400fbd91450e36974401'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.674194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82eb1486d8a2400fbd91450e36974401'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.685276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82eb1486d8a2400fbd91450e36974401'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.712945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1081/2149] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:21 2022] DELETE /identity/v3/users/82eb1486d8a2400fbd91450e36974401 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:21.717810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bbfa6-2f67-4b52-9ffc-3d2c145c6116 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:21.719215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bbfa6-2f67-4b52-9ffc-3d2c145c6116 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:21.719510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bbfa6-2f67-4b52-9ffc-3d2c145c6116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:21.747773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-8d7bbfa6-2f67-4b52-9ffc-3d2c145c6116 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:21.748979 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-8d7bbfa6-2f67-4b52-9ffc-3d2c145c6116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:21.792128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:21.792529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:21.824449 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1069/2150] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:21.835084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bbfa6-2f67-4b52-9ffc-3d2c145c6116 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:21.837123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-8d7bbfa6-2f67-4b52-9ffc-3d2c145c6116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:21.863165 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96647d-88ff-4877-8873-70d639f3e3cd admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:21.869384 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:21.871075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:21.871508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:21.871927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] PATH_INFO: `/v3/users/a73b5ea81d1942c895598ed576133e0f` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:21.873300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73b5ea81d1942c895598ed576133e0f)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:21.875326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:21.900503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bbfa6-2f67-4b52-9ffc-3d2c145c6116 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:21.904943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720717e-d73e-4c57-9f0b-9926161690c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:21.905676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720717e-d73e-4c57-9f0b-9926161690c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:21.906105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720717e-d73e-4c57-9f0b-9926161690c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:21.906493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720717e-d73e-4c57-9f0b-9926161690c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:21.918360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720717e-d73e-4c57-9f0b-9926161690c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:21.919967 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720717e-d73e-4c57-9f0b-9926161690c3 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:21.934466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1070/2151] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:21.938873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73b5ea81d1942c895598ed576133e0f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.939658 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73b5ea81d1942c895598ed576133e0f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.940343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73b5ea81d1942c895598ed576133e0f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.953873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73b5ea81d1942c895598ed576133e0f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.962136 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73b5ea81d1942c895598ed576133e0f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:21.981586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1082/2152] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:21 2022] DELETE /identity/v3/users/a73b5ea81d1942c895598ed576133e0f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:21.986384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01654bd-a5ec-4627-9453-19c189cb178d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:21.987374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01654bd-a5ec-4627-9453-19c189cb178d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:21.987651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01654bd-a5ec-4627-9453-19c189cb178d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:22.009924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-f01654bd-a5ec-4627-9453-19c189cb178d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:22.012024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f01654bd-a5ec-4627-9453-19c189cb178d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:22.104582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1071/2153] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:22.121598 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:22.123525 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:22.199111 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612cc5-abc1-4da2-b2db-d3edceebcba2 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:22.205104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6e97d-88d7-48a6-83ba-72a207449bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:22.205940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e97d-88d7-48a6-83ba-72a207449bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:22.206375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e97d-88d7-48a6-83ba-72a207449bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:22.206827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e97d-88d7-48a6-83ba-72a207449bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:22.224935 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6e97d-88d7-48a6-83ba-72a207449bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:22.229173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6e97d-88d7-48a6-83ba-72a207449bc6 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:22.246747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1083/2154] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:22.253249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01654bd-a5ec-4627-9453-19c189cb178d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:22.254789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f01654bd-a5ec-4627-9453-19c189cb178d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:22.274001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01654bd-a5ec-4627-9453-19c189cb178d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:22.283992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:22.285361 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:22.285665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:22.286538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] PATH_INFO: `/v3/projects/16f2cdbdf08242f1ba83a74a33b2a1d9` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:22.288073 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f2cdbdf08242f1ba83a74a33b2a1d9)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:22.290044 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:22.372445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f2cdbdf08242f1ba83a74a33b2a1d9', 'request_id': 'req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:22.381345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f2cdbdf08242f1ba83a74a33b2a1d9', 'request_id': 'req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:22.391448 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f2cdbdf08242f1ba83a74a33b2a1d9', 'request_id': 'req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:22.411570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] The token cache is being invalidate because project 16f2cdbdf08242f1ba83a74a33b2a1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:22.412594 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:22.418207 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ac44e6ac-2a13-41df-a2b7-f1d9b63370e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:22.420538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1072/2155] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:22 2022] DELETE /identity/v3/projects/16f2cdbdf08242f1ba83a74a33b2a1d9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:22.427067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85db43-36bf-49a8-aee6-93401bc39690 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:22.427325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85db43-36bf-49a8-aee6-93401bc39690 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:22.427606 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85db43-36bf-49a8-aee6-93401bc39690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:22.448593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-4c85db43-36bf-49a8-aee6-93401bc39690 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:22.449305 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4c85db43-36bf-49a8-aee6-93401bc39690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:22.526060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1084/2156] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:22.528669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c63b0-4886-43bc-9f63-0e4933919b4c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:22.529271 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c63b0-4886-43bc-9f63-0e4933919b4c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:22.529714 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c63b0-4886-43bc-9f63-0e4933919b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:22.552729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-116c63b0-4886-43bc-9f63-0e4933919b4c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:22.554076 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-116c63b0-4886-43bc-9f63-0e4933919b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:22.565600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1073/2157] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:22.570039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85db43-36bf-49a8-aee6-93401bc39690 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:22.583930 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85db43-36bf-49a8-aee6-93401bc39690 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:22.589965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56593f1b-c7ab-42c3-93fb-10d81f6b0b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:22.590646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593f1b-c7ab-42c3-93fb-10d81f6b0b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:22.590951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593f1b-c7ab-42c3-93fb-10d81f6b0b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:22.591234 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593f1b-c7ab-42c3-93fb-10d81f6b0b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:22.592162 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56593f1b-c7ab-42c3-93fb-10d81f6b0b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:22.592476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56593f1b-c7ab-42c3-93fb-10d81f6b0b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:22.594210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56593f1b-c7ab-42c3-93fb-10d81f6b0b76 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:22.609075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1085/2158] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:22.616614 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c63b0-4886-43bc-9f63-0e4933919b4c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:22.627212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c63b0-4886-43bc-9f63-0e4933919b4c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:22.632570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e955-4c0d-4098-9bc6-573fb784f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:22.633334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e955-4c0d-4098-9bc6-573fb784f29a admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:22.633710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e955-4c0d-4098-9bc6-573fb784f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:22.634079 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e955-4c0d-4098-9bc6-573fb784f29a admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:22.634875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28e955-4c0d-4098-9bc6-573fb784f29a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:22.636952 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28e955-4c0d-4098-9bc6-573fb784f29a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:22.675017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1074/2159] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:22 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:22.676761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56593f1b-c7ab-42c3-93fb-10d81f6b0b76 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:22.687460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56593f1b-c7ab-42c3-93fb-10d81f6b0b76 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:22.765703 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f700e2-235f-4037-beef-988139dcc49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:22.766523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f700e2-235f-4037-beef-988139dcc49f admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:22.767040 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f700e2-235f-4037-beef-988139dcc49f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:22.767413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f700e2-235f-4037-beef-988139dcc49f admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:22.768265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f700e2-235f-4037-beef-988139dcc49f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:22.770179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f700e2-235f-4037-beef-988139dcc49f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:22.796524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1086/2160] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:22 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:22.801695 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e955-4c0d-4098-9bc6-573fb784f29a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:22.834203 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e955-4c0d-4098-9bc6-573fb784f29a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:22.841872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f700e2-235f-4037-beef-988139dcc49f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:22.843546 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f6270-8172-47ef-8ae3-85099b70a9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:22.843912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-b0f700e2-235f-4037-beef-988139dcc49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:22.844511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f6270-8172-47ef-8ae3-85099b70a9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:22.845530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f6270-8172-47ef-8ae3-85099b70a9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:22.845884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f6270-8172-47ef-8ae3-85099b70a9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:22.846714 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f6270-8172-47ef-8ae3-85099b70a9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:22.849113 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f6270-8172-47ef-8ae3-85099b70a9b4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:22.865924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f700e2-235f-4037-beef-988139dcc49f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:22.873775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:22.874648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:22.874952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:22.875229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] PATH_INFO: `/v3/projects/0f3e066213d24253a1fa4569be27bc3a` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:22.876454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3e066213d24253a1fa4569be27bc3a)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:22.893281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1075/2161] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:22.893434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:22.894869 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f6270-8172-47ef-8ae3-85099b70a9b4 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:22.920982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f6270-8172-47ef-8ae3-85099b70a9b4 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:22.932994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6f775-2b76-463a-8c27-e1dcb5d433c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:22.934066 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6f775-2b76-463a-8c27-e1dcb5d433c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:22.934601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6f775-2b76-463a-8c27-e1dcb5d433c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:22.934877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6f775-2b76-463a-8c27-e1dcb5d433c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:22.935676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6f775-2b76-463a-8c27-e1dcb5d433c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:22.937730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6f775-2b76-463a-8c27-e1dcb5d433c7 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:22.955939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1076/2162] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:22.957842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6f775-2b76-463a-8c27-e1dcb5d433c7 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:22.970135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6f775-2b76-463a-8c27-e1dcb5d433c7 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:22.991696 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3e066213d24253a1fa4569be27bc3a', 'request_id': 'req-decfc1f5-73ea-4104-a2b9-713668ae4d41'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.001112 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3e066213d24253a1fa4569be27bc3a', 'request_id': 'req-decfc1f5-73ea-4104-a2b9-713668ae4d41'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.008307 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3e066213d24253a1fa4569be27bc3a', 'request_id': 'req-decfc1f5-73ea-4104-a2b9-713668ae4d41'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.026234 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] The token cache is being invalidate because project 0f3e066213d24253a1fa4569be27bc3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:23.027375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.029874 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.035166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1087/2163] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:22 2022] DELETE /identity/v3/projects/0f3e066213d24253a1fa4569be27bc3a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:23.037926 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:23.040244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:23.057291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259fe31-c036-49e3-a9f2-aec68fa21567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:23.057818 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fe31-c036-49e3-a9f2-aec68fa21567 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:23.058162 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fe31-c036-49e3-a9f2-aec68fa21567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:23.058667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fe31-c036-49e3-a9f2-aec68fa21567 admin admin] PATH_INFO: `/v3/projects/26dd6355f38f46af9815bde5526360db/users/3b5e3d104f1c4a0ba55f9121bc3a0250/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:23.105209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259fe31-c036-49e3-a9f2-aec68fa21567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26dd6355f38f46af9815bde5526360db, user_id=3b5e3d104f1c4a0ba55f9121bc3a0250, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:23.105209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259fe31-c036-49e3-a9f2-aec68fa21567 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:23.130444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1077/2164] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:22 2022] PUT /identity/v3/projects/26dd6355f38f46af9815bde5526360db/users/3b5e3d104f1c4a0ba55f9121bc3a0250/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:23.132169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e708195-0cb1-44a7-91b1-8b27970f931f None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:23.132326 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e708195-0cb1-44a7-91b1-8b27970f931f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:23.132835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e708195-0cb1-44a7-91b1-8b27970f931f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:23.148585 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfc1f5-73ea-4104-a2b9-713668ae4d41 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:23.156243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-3e708195-0cb1-44a7-91b1-8b27970f931f None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:23.157702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3e708195-0cb1-44a7-91b1-8b27970f931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:23.212485 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:23.213357 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:23.213797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:23.214634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] PATH_INFO: `/v3/users/5c3edc9b7f964530bdae4910bd98a7a1` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:23.215884 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3edc9b7f964530bdae4910bd98a7a1)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:23.217795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:23.232852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1078/2165] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:23.242983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e708195-0cb1-44a7-91b1-8b27970f931f None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:23.244432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3e708195-0cb1-44a7-91b1-8b27970f931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:23.286033 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3edc9b7f964530bdae4910bd98a7a1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.287019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3edc9b7f964530bdae4910bd98a7a1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.287904 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3edc9b7f964530bdae4910bd98a7a1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.303623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3edc9b7f964530bdae4910bd98a7a1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.310159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e708195-0cb1-44a7-91b1-8b27970f931f None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:23.314644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56778b75-2b1d-4f93-a6a9-4d479b016c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:23.315317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3edc9b7f964530bdae4910bd98a7a1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.316588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56778b75-2b1d-4f93-a6a9-4d479b016c62 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:23.316816 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56778b75-2b1d-4f93-a6a9-4d479b016c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:23.317107 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56778b75-2b1d-4f93-a6a9-4d479b016c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:23.319308 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-56778b75-2b1d-4f93-a6a9-4d479b016c62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:23.334994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56778b75-2b1d-4f93-a6a9-4d479b016c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:23.336660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56778b75-2b1d-4f93-a6a9-4d479b016c62 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:23.344281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1088/2166] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:23 2022] DELETE /identity/v3/users/5c3edc9b7f964530bdae4910bd98a7a1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:23.352786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1079/2167] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:23.768442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:23.769886 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:23.884120 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a789b-845c-463c-9af9-2f059b6b4b19 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:23.899019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:23.903245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:23.903245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:23.903245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] PATH_INFO: `/v3/projects/b488c6e659ae49ab8708d4496979ce78` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:23.904818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b488c6e659ae49ab8708d4496979ce78)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:23.908190 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:23.980879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b488c6e659ae49ab8708d4496979ce78', 'request_id': 'req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.988629 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b488c6e659ae49ab8708d4496979ce78', 'request_id': 'req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.994816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b488c6e659ae49ab8708d4496979ce78', 'request_id': 'req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:24.009763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] The token cache is being invalidate because project b488c6e659ae49ab8708d4496979ce78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:24.010190 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:24.011056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e6012ef9-240d-41d0-8e7d-1d2fefcc1999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:24.012798 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1089/2168] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:23 2022] DELETE /identity/v3/projects/b488c6e659ae49ab8708d4496979ce78 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:24.017431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26d613-52ad-403c-a2bd-b9deb50d5523 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.017915 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26d613-52ad-403c-a2bd-b9deb50d5523 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.018005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26d613-52ad-403c-a2bd-b9deb50d5523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.039263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-2e26d613-52ad-403c-a2bd-b9deb50d5523 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:24.040477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-2e26d613-52ad-403c-a2bd-b9deb50d5523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:24.118982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1080/2169] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:24.123076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baadb1f-6c75-4892-8346-941e45ffdeff None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.123366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baadb1f-6c75-4892-8346-941e45ffdeff None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.123659 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baadb1f-6c75-4892-8346-941e45ffdeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.145255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-3baadb1f-6c75-4892-8346-941e45ffdeff None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:24.147029 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3baadb1f-6c75-4892-8346-941e45ffdeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:24.156346 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1090/2170] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:24.160522 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26d613-52ad-403c-a2bd-b9deb50d5523 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.172524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26d613-52ad-403c-a2bd-b9deb50d5523 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.177857 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2b03a-a380-4579-97a8-95586af3e3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.178351 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b03a-a380-4579-97a8-95586af3e3cd admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.178627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b03a-a380-4579-97a8-95586af3e3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.178924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b03a-a380-4579-97a8-95586af3e3cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.179639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2b03a-a380-4579-97a8-95586af3e3cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:24.179941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2b03a-a380-4579-97a8-95586af3e3cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.181538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2b03a-a380-4579-97a8-95586af3e3cd admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.200756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1081/2171] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:24.211617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baadb1f-6c75-4892-8346-941e45ffdeff None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.240608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baadb1f-6c75-4892-8346-941e45ffdeff None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.247247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571ad43-740d-404c-8051-af759f40af72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.248086 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ad43-740d-404c-8051-af759f40af72 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.248742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ad43-740d-404c-8051-af759f40af72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.249256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ad43-740d-404c-8051-af759f40af72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.250414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571ad43-740d-404c-8051-af759f40af72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.252762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571ad43-740d-404c-8051-af759f40af72 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.286154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1091/2172] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:24.290409 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2b03a-a380-4579-97a8-95586af3e3cd admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.304275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2b03a-a380-4579-97a8-95586af3e3cd admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.370387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf69165-c8cd-45a0-84c0-4b67ad517957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.371094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf69165-c8cd-45a0-84c0-4b67ad517957 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.371369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf69165-c8cd-45a0-84c0-4b67ad517957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.371634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf69165-c8cd-45a0-84c0-4b67ad517957 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.372326 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf69165-c8cd-45a0-84c0-4b67ad517957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.374253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf69165-c8cd-45a0-84c0-4b67ad517957 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.395947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1082/2173] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:24.400235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571ad43-740d-404c-8051-af759f40af72 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.414729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571ad43-740d-404c-8051-af759f40af72 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.419536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e388f3f-118d-48d5-8b9a-dd62cbef8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.420205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e388f3f-118d-48d5-8b9a-dd62cbef8b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.420480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e388f3f-118d-48d5-8b9a-dd62cbef8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.420749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e388f3f-118d-48d5-8b9a-dd62cbef8b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.421479 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e388f3f-118d-48d5-8b9a-dd62cbef8b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.423109 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e388f3f-118d-48d5-8b9a-dd62cbef8b13 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.434161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1092/2174] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:24.438386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf69165-c8cd-45a0-84c0-4b67ad517957 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.449152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf69165-c8cd-45a0-84c0-4b67ad517957 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.454005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807c5f6-bf1f-4e46-a272-bfdfda39ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.454673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c5f6-bf1f-4e46-a272-bfdfda39ef00 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.454991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c5f6-bf1f-4e46-a272-bfdfda39ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.455270 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c5f6-bf1f-4e46-a272-bfdfda39ef00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.455999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807c5f6-bf1f-4e46-a272-bfdfda39ef00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.457608 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807c5f6-bf1f-4e46-a272-bfdfda39ef00 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.472070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1083/2175] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:24.473257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e388f3f-118d-48d5-8b9a-dd62cbef8b13 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.483468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e388f3f-118d-48d5-8b9a-dd62cbef8b13 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.488100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fea2b5-c3eb-4daa-8dd9-4c2c9cf631e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.488979 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea2b5-c3eb-4daa-8dd9-4c2c9cf631e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.489254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea2b5-c3eb-4daa-8dd9-4c2c9cf631e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.489526 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea2b5-c3eb-4daa-8dd9-4c2c9cf631e1 admin admin] PATH_INFO: `/v3/projects/208b17f356db45ecb1c9b1f1b51348a0/users/09b6eaf61a9340f8aa8d1acaa06f3ac3/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.505035 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fea2b5-c3eb-4daa-8dd9-4c2c9cf631e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208b17f356db45ecb1c9b1f1b51348a0, user_id=09b6eaf61a9340f8aa8d1acaa06f3ac3, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.507982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fea2b5-c3eb-4daa-8dd9-4c2c9cf631e1 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.528340 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1093/2176] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:24 2022] PUT /identity/v3/projects/208b17f356db45ecb1c9b1f1b51348a0/users/09b6eaf61a9340f8aa8d1acaa06f3ac3/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:24.534612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f5ab-4f9d-4e0a-8807-85112730f5b4 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.534921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f5ab-4f9d-4e0a-8807-85112730f5b4 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.535362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f5ab-4f9d-4e0a-8807-85112730f5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.567510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-5328f5ab-4f9d-4e0a-8807-85112730f5b4 None None] MFA Rules not processed for user `09b6eaf61a9340f8aa8d1acaa06f3ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:24.568713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5328f5ab-4f9d-4e0a-8807-85112730f5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:24.642199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1084/2177] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:24.643398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fea2b5-c3eb-4daa-8dd9-4c2c9cf631e1 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.740494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fea2b5-c3eb-4daa-8dd9-4c2c9cf631e1 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.745600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b06a8-0343-46b9-9c09-372cb1704e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.746396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b06a8-0343-46b9-9c09-372cb1704e36 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.746679 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b06a8-0343-46b9-9c09-372cb1704e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.746991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b06a8-0343-46b9-9c09-372cb1704e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.747970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b06a8-0343-46b9-9c09-372cb1704e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.748986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058000-9d5a-457c-ba93-47e997654f1f None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.749276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058000-9d5a-457c-ba93-47e997654f1f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.749829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058000-9d5a-457c-ba93-47e997654f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.749977 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b06a8-0343-46b9-9c09-372cb1704e36 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.784904 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1094/2178] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:24.787620 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-1d058000-9d5a-457c-ba93-47e997654f1f None None] MFA Rules not processed for user `3b5e3d104f1c4a0ba55f9121bc3a0250`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:24.789069 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-1d058000-9d5a-457c-ba93-47e997654f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:24.790285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b06a8-0343-46b9-9c09-372cb1704e36 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.855184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b06a8-0343-46b9-9c09-372cb1704e36 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.859782 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1085/2179] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:24.860488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21772c88-3b0b-4445-a0c1-716ae581da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.861259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21772c88-3b0b-4445-a0c1-716ae581da8c admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.861765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21772c88-3b0b-4445-a0c1-716ae581da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.862140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21772c88-3b0b-4445-a0c1-716ae581da8c admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.863101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21772c88-3b0b-4445-a0c1-716ae581da8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.865538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21772c88-3b0b-4445-a0c1-716ae581da8c admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.871518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058000-9d5a-457c-ba93-47e997654f1f None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.872955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-1d058000-9d5a-457c-ba93-47e997654f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:24.898432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1095/2180] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:24.902220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21772c88-3b0b-4445-a0c1-716ae581da8c admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.911984 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21772c88-3b0b-4445-a0c1-716ae581da8c admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.917553 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9043b-d9ec-4f43-872f-de9a4f5324ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.918335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9043b-d9ec-4f43-872f-de9a4f5324ca admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.918625 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9043b-d9ec-4f43-872f-de9a4f5324ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.918912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9043b-d9ec-4f43-872f-de9a4f5324ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.919644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9043b-d9ec-4f43-872f-de9a4f5324ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.921278 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9043b-d9ec-4f43-872f-de9a4f5324ca admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.932530 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1096/2181] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:24.937378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9043b-d9ec-4f43-872f-de9a4f5324ca admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.940560 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058000-9d5a-457c-ba93-47e997654f1f None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.944399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdf5d4-5bd9-4582-b04f-410ca022bc85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.945037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdf5d4-5bd9-4582-b04f-410ca022bc85 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.945319 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdf5d4-5bd9-4582-b04f-410ca022bc85 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.945595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdf5d4-5bd9-4582-b04f-410ca022bc85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.948654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9043b-d9ec-4f43-872f-de9a4f5324ca admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.955033 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdf5d4-5bd9-4582-b04f-410ca022bc85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.956484 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdf5d4-5bd9-4582-b04f-410ca022bc85 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.956861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa784b3-70c9-4d0a-a4d9-5c032ccbd52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.958529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa784b3-70c9-4d0a-a4d9-5c032ccbd52b admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.958816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa784b3-70c9-4d0a-a4d9-5c032ccbd52b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.959124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa784b3-70c9-4d0a-a4d9-5c032ccbd52b admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.959851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa784b3-70c9-4d0a-a4d9-5c032ccbd52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.961458 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa784b3-70c9-4d0a-a4d9-5c032ccbd52b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.965982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1086/2182] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:24.976891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1097/2183] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:24.977944 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdf5d4-5bd9-4582-b04f-410ca022bc85 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.990361 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdf5d4-5bd9-4582-b04f-410ca022bc85 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.994893 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac48d4-955d-4883-9647-0b26cd56659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.996313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac48d4-955d-4883-9647-0b26cd56659c admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.996609 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac48d4-955d-4883-9647-0b26cd56659c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.996880 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac48d4-955d-4883-9647-0b26cd56659c admin admin] PATH_INFO: `/v3/projects/67f5a221479845a3b9f326213ba18aac/users/9527f5b6f9dd4b628dacacc39297d8dd/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.012028 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac48d4-955d-4883-9647-0b26cd56659c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f5a221479845a3b9f326213ba18aac, user_id=9527f5b6f9dd4b628dacacc39297d8dd, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.014697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac48d4-955d-4883-9647-0b26cd56659c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.027515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1087/2184] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:24 2022] PUT /identity/v3/projects/67f5a221479845a3b9f326213ba18aac/users/9527f5b6f9dd4b628dacacc39297d8dd/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:25.037947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5759559-2a1c-48e6-aca8-be316b640076 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.038339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5759559-2a1c-48e6-aca8-be316b640076 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.038623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5759559-2a1c-48e6-aca8-be316b640076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.072015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-b5759559-2a1c-48e6-aca8-be316b640076 None None] MFA Rules not processed for user `9527f5b6f9dd4b628dacacc39297d8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:25.073388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-b5759559-2a1c-48e6-aca8-be316b640076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:25.146716 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1098/2185] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:25.151446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac48d4-955d-4883-9647-0b26cd56659c admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.226981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac48d4-955d-4883-9647-0b26cd56659c admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.240177 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e304b-6cf9-405f-be9a-ffa904b8157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.240926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e304b-6cf9-405f-be9a-ffa904b8157e admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.241278 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e304b-6cf9-405f-be9a-ffa904b8157e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.243150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e304b-6cf9-405f-be9a-ffa904b8157e admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.243150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e304b-6cf9-405f-be9a-ffa904b8157e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.244575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e304b-6cf9-405f-be9a-ffa904b8157e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.286161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1088/2186] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:25 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:25.286755 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5759559-2a1c-48e6-aca8-be316b640076 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.302313 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5759559-2a1c-48e6-aca8-be316b640076 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.372487 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49742c-ec10-436a-9f99-b867f4717715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.373206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49742c-ec10-436a-9f99-b867f4717715 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.375574 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49742c-ec10-436a-9f99-b867f4717715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.379206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49742c-ec10-436a-9f99-b867f4717715 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.380800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49742c-ec10-436a-9f99-b867f4717715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.383015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49742c-ec10-436a-9f99-b867f4717715 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.412601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1099/2187] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:25 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:25.416577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e304b-6cf9-405f-be9a-ffa904b8157e admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.427893 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e304b-6cf9-405f-be9a-ffa904b8157e admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.436032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d0080-8e56-4113-a506-e304855da5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.437085 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d0080-8e56-4113-a506-e304855da5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.437363 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d0080-8e56-4113-a506-e304855da5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.437634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d0080-8e56-4113-a506-e304855da5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.438394 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d0080-8e56-4113-a506-e304855da5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.440020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d0080-8e56-4113-a506-e304855da5d1 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.451660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1089/2188] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:25.455461 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49742c-ec10-436a-9f99-b867f4717715 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.473097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49742c-ec10-436a-9f99-b867f4717715 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.477106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488305-51c2-4dad-b555-23eb21e83520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.478363 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488305-51c2-4dad-b555-23eb21e83520 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.479078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488305-51c2-4dad-b555-23eb21e83520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.479967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488305-51c2-4dad-b555-23eb21e83520 admin admin] PATH_INFO: `/v3/projects/b8d1d02e59774ff099f03aba936bc881/users/773958ebdeaa4e26aeff79168ae218b3/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.497874 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c488305-51c2-4dad-b555-23eb21e83520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d1d02e59774ff099f03aba936bc881, user_id=773958ebdeaa4e26aeff79168ae218b3, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.500637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c488305-51c2-4dad-b555-23eb21e83520 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.514719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1100/2189] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:25 2022] PUT /identity/v3/projects/b8d1d02e59774ff099f03aba936bc881/users/773958ebdeaa4e26aeff79168ae218b3/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:25.518425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d0080-8e56-4113-a506-e304855da5d1 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.528839 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d0080-8e56-4113-a506-e304855da5d1 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.586685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173467f-dae6-499e-b5a8-7a16a8d47ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.586685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173467f-dae6-499e-b5a8-7a16a8d47ece admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.586685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173467f-dae6-499e-b5a8-7a16a8d47ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.586685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173467f-dae6-499e-b5a8-7a16a8d47ece admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.587349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173467f-dae6-499e-b5a8-7a16a8d47ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.588601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173467f-dae6-499e-b5a8-7a16a8d47ece admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.599428 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1090/2190] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:25.603651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488305-51c2-4dad-b555-23eb21e83520 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.614598 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488305-51c2-4dad-b555-23eb21e83520 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.619265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c8c3c-f7ec-4700-b949-0535b74a87f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.620192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c8c3c-f7ec-4700-b949-0535b74a87f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.620541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c8c3c-f7ec-4700-b949-0535b74a87f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.620875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c8c3c-f7ec-4700-b949-0535b74a87f1 admin admin] PATH_INFO: `/v3/projects/b8d1d02e59774ff099f03aba936bc881/users/773958ebdeaa4e26aeff79168ae218b3/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.622949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c8c3c-f7ec-4700-b949-0535b74a87f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d1d02e59774ff099f03aba936bc881, user_id=773958ebdeaa4e26aeff79168ae218b3, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.625637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c8c3c-f7ec-4700-b949-0535b74a87f1 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.636099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1101/2191] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:25 2022] PUT /identity/v3/projects/b8d1d02e59774ff099f03aba936bc881/users/773958ebdeaa4e26aeff79168ae218b3/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:25.646629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe09c-451a-4b3c-8980-be59ecbbb783 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.647214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe09c-451a-4b3c-8980-be59ecbbb783 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.647680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe09c-451a-4b3c-8980-be59ecbbb783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.675884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-2fffe09c-451a-4b3c-8980-be59ecbbb783 None None] MFA Rules not processed for user `773958ebdeaa4e26aeff79168ae218b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:25.677620 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-2fffe09c-451a-4b3c-8980-be59ecbbb783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:25.750456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1091/2192] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:25.762430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c8c3c-f7ec-4700-b949-0535b74a87f1 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.764729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ab5c8c3c-f7ec-4700-b949-0535b74a87f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:25.834001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c8c3c-f7ec-4700-b949-0535b74a87f1 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.839401 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c28587-29b0-493e-8a5f-95e6b3f48980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.840038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28587-29b0-493e-8a5f-95e6b3f48980 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.840445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28587-29b0-493e-8a5f-95e6b3f48980 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.840721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28587-29b0-493e-8a5f-95e6b3f48980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.851056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c28587-29b0-493e-8a5f-95e6b3f48980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.852882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c28587-29b0-493e-8a5f-95e6b3f48980 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.864122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1102/2193] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:25.922101 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffe09c-451a-4b3c-8980-be59ecbbb783 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.932710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffe09c-451a-4b3c-8980-be59ecbbb783 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.944838 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7458f-86e3-4846-b0eb-86fb18dfc73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.945526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7458f-86e3-4846-b0eb-86fb18dfc73a service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.945790 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7458f-86e3-4846-b0eb-86fb18dfc73a service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.946062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7458f-86e3-4846-b0eb-86fb18dfc73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:26.028930 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7458f-86e3-4846-b0eb-86fb18dfc73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:26.030366 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7458f-86e3-4846-b0eb-86fb18dfc73a service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:26.039943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1092/2194] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:26.398408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca41069-2bf2-41fc-914d-6070ea062abd None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:26.398891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca41069-2bf2-41fc-914d-6070ea062abd None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:26.399004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca41069-2bf2-41fc-914d-6070ea062abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:26.419701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-bca41069-2bf2-41fc-914d-6070ea062abd None None] MFA Rules not processed for user `3b5e3d104f1c4a0ba55f9121bc3a0250`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:26.421830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-bca41069-2bf2-41fc-914d-6070ea062abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:26.522945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1103/2195] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:29.066579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7458f-86e3-4846-b0eb-86fb18dfc73a service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:29.160559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7458f-86e3-4846-b0eb-86fb18dfc73a service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:29.170419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:29.171497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.171886 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.172270 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] PATH_INFO: `/v3/users/09b6eaf61a9340f8aa8d1acaa06f3ac3` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.174627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b6eaf61a9340f8aa8d1acaa06f3ac3)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:29.176946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:29.241939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b6eaf61a9340f8aa8d1acaa06f3ac3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:29.242734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b6eaf61a9340f8aa8d1acaa06f3ac3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:29.255651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b6eaf61a9340f8aa8d1acaa06f3ac3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:29.265200 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b6eaf61a9340f8aa8d1acaa06f3ac3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:29.273071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b6eaf61a9340f8aa8d1acaa06f3ac3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:29.280263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1093/2196] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:29 2022] DELETE /identity/v3/users/09b6eaf61a9340f8aa8d1acaa06f3ac3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:29.288796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc72b39-73e2-45f0-b459-43e5cca6f69c None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.289301 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc72b39-73e2-45f0-b459-43e5cca6f69c None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.289390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc72b39-73e2-45f0-b459-43e5cca6f69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.309101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-8fc72b39-73e2-45f0-b459-43e5cca6f69c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:29.310295 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8fc72b39-73e2-45f0-b459-43e5cca6f69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:29.371258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1104/2197] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:29.385258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:29.391013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:29.451435 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535510a3-31af-4ef5-8434-f34427dd83ea admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:29.455673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2524845-bff1-47ca-b6f0-f4cb784e400c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:29.456539 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2524845-bff1-47ca-b6f0-f4cb784e400c service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.457014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2524845-bff1-47ca-b6f0-f4cb784e400c service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.457345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2524845-bff1-47ca-b6f0-f4cb784e400c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.468146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2524845-bff1-47ca-b6f0-f4cb784e400c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:29.469685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2524845-bff1-47ca-b6f0-f4cb784e400c service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:29.481567 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1094/2198] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:30.083311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc72b39-73e2-45f0-b459-43e5cca6f69c None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:30.085651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8fc72b39-73e2-45f0-b459-43e5cca6f69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:30.099446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc72b39-73e2-45f0-b459-43e5cca6f69c None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:30.107081 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:30.108030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:30.109277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:30.109710 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] PATH_INFO: `/v3/projects/208b17f356db45ecb1c9b1f1b51348a0` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:30.111300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=208b17f356db45ecb1c9b1f1b51348a0)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:30.113514 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:30.191826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208b17f356db45ecb1c9b1f1b51348a0', 'request_id': 'req-593acc0b-c0d4-4c3a-b744-5314e87232d9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:30.203049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208b17f356db45ecb1c9b1f1b51348a0', 'request_id': 'req-593acc0b-c0d4-4c3a-b744-5314e87232d9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:30.211695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208b17f356db45ecb1c9b1f1b51348a0', 'request_id': 'req-593acc0b-c0d4-4c3a-b744-5314e87232d9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:30.227148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] The token cache is being invalidate because project 208b17f356db45ecb1c9b1f1b51348a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:30.227472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:30.228374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:30.230501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1105/2199] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:30 2022] DELETE /identity/v3/projects/208b17f356db45ecb1c9b1f1b51348a0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:30.234318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2524845-bff1-47ca-b6f0-f4cb784e400c service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:30.254148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2524845-bff1-47ca-b6f0-f4cb784e400c service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:30.390871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:30.391834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:30.392198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:30.392532 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] PATH_INFO: `/v3/users/9527f5b6f9dd4b628dacacc39297d8dd` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:30.393778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9527f5b6f9dd4b628dacacc39297d8dd)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:30.395803 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:30.450653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9527f5b6f9dd4b628dacacc39297d8dd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:30.451493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9527f5b6f9dd4b628dacacc39297d8dd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:30.465872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9527f5b6f9dd4b628dacacc39297d8dd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:30.473608 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9527f5b6f9dd4b628dacacc39297d8dd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:30.481557 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9527f5b6f9dd4b628dacacc39297d8dd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:30.506067 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1095/2200] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:30 2022] DELETE /identity/v3/users/9527f5b6f9dd4b628dacacc39297d8dd => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:30.865480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:30.867324 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:30.883532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593acc0b-c0d4-4c3a-b744-5314e87232d9 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:30.971884 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:30.973270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:30.973567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:30.973947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] PATH_INFO: `/v3/users/6314c5e3ae2442cf90b0299e47999654` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:30.975426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6314c5e3ae2442cf90b0299e47999654)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:30.977855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:31.123675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6314c5e3ae2442cf90b0299e47999654'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.124368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6314c5e3ae2442cf90b0299e47999654'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.124992 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6314c5e3ae2442cf90b0299e47999654'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.141060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6314c5e3ae2442cf90b0299e47999654'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.153286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6314c5e3ae2442cf90b0299e47999654'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.190505 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1106/2201] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:30 2022] DELETE /identity/v3/users/6314c5e3ae2442cf90b0299e47999654 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:31.330238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:31.332461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:31.359047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f3e27-19ae-4470-b71b-b79c63baa80e admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:31.447728 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:31.449590 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:31.449977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:31.450461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] PATH_INFO: `/v3/projects/67f5a221479845a3b9f326213ba18aac` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:31.452200 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f5a221479845a3b9f326213ba18aac)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:31.454286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:31.498188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:31.500394 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:31.529019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e6830-ad64-4553-a75b-504bc2bde53e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:31.539162 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f5a221479845a3b9f326213ba18aac', 'request_id': 'req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.545002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f5a221479845a3b9f326213ba18aac', 'request_id': 'req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.552491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f5a221479845a3b9f326213ba18aac', 'request_id': 'req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.575127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] The token cache is being invalidate because project 67f5a221479845a3b9f326213ba18aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:31.575574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.576218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.581355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1096/2202] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:31 2022] DELETE /identity/v3/projects/67f5a221479845a3b9f326213ba18aac => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:31.582487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:31.583958 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:31.608443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:31.609594 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:31.610106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:31.610393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] PATH_INFO: `/v3/projects/d07247712e664711bc6778d697ef6757` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:31.611832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07247712e664711bc6778d697ef6757)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:31.613865 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:31.649014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13ea5-7439-4e80-84ff-d1019e4b0a41 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:31.668634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07247712e664711bc6778d697ef6757', 'request_id': 'req-aa93a69d-8485-4160-9268-662c66847a90'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.674365 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07247712e664711bc6778d697ef6757', 'request_id': 'req-aa93a69d-8485-4160-9268-662c66847a90'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.681551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07247712e664711bc6778d697ef6757', 'request_id': 'req-aa93a69d-8485-4160-9268-662c66847a90'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.695090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] The token cache is being invalidate because project d07247712e664711bc6778d697ef6757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:31.695385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.696126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-aa93a69d-8485-4160-9268-662c66847a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.697864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1107/2203] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:31 2022] DELETE /identity/v3/projects/d07247712e664711bc6778d697ef6757 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:31.708672 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea60e-862e-402d-8d2d-6ed546eaf675 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:31.710687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea60e-862e-402d-8d2d-6ed546eaf675 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:31.710998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea60e-862e-402d-8d2d-6ed546eaf675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:31.719074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:31.720071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:31.720360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:31.720632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] PATH_INFO: `/v3/users/773958ebdeaa4e26aeff79168ae218b3` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:31.721842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773958ebdeaa4e26aeff79168ae218b3)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:31.723805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:31.729808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-51bea60e-862e-402d-8d2d-6ed546eaf675 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:31.731169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-51bea60e-862e-402d-8d2d-6ed546eaf675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:31.739019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1108/2204] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:31.749230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec337a1-4b21-4470-931e-3d832b90e6d5 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:31.749230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec337a1-4b21-4470-931e-3d832b90e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:31.749230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec337a1-4b21-4470-931e-3d832b90e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:31.767367 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-cec337a1-4b21-4470-931e-3d832b90e6d5 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:31.768563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cec337a1-4b21-4470-931e-3d832b90e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:31.777692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1109/2205] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:31.782225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec337a1-4b21-4470-931e-3d832b90e6d5 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:31.790265 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773958ebdeaa4e26aeff79168ae218b3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.791015 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773958ebdeaa4e26aeff79168ae218b3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.791459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec337a1-4b21-4470-931e-3d832b90e6d5 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:31.797073 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8db9e-1a72-43d0-bfd4-ce2db4a483a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:31.797744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8db9e-1a72-43d0-bfd4-ce2db4a483a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:31.798022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8db9e-1a72-43d0-bfd4-ce2db4a483a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:31.798414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8db9e-1a72-43d0-bfd4-ce2db4a483a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:31.799038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8db9e-1a72-43d0-bfd4-ce2db4a483a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:31.799347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8db9e-1a72-43d0-bfd4-ce2db4a483a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:31.800922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8db9e-1a72-43d0-bfd4-ce2db4a483a6 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:31.802984 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773958ebdeaa4e26aeff79168ae218b3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.812675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773958ebdeaa4e26aeff79168ae218b3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.813449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1110/2206] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:31.817934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8db9e-1a72-43d0-bfd4-ce2db4a483a6 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:31.819691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-55e8db9e-1a72-43d0-bfd4-ce2db4a483a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:31.820119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773958ebdeaa4e26aeff79168ae218b3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:31.831316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1097/2207] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:31 2022] DELETE /identity/v3/users/773958ebdeaa4e26aeff79168ae218b3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:31.833661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8db9e-1a72-43d0-bfd4-ce2db4a483a6 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:31.894896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3853c81-2d3b-49a3-b49c-d588cfbecf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:31.895689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3853c81-2d3b-49a3-b49c-d588cfbecf93 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:31.896030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3853c81-2d3b-49a3-b49c-d588cfbecf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:31.896404 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3853c81-2d3b-49a3-b49c-d588cfbecf93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:31.897159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3853c81-2d3b-49a3-b49c-d588cfbecf93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:31.899178 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3853c81-2d3b-49a3-b49c-d588cfbecf93 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:31.931461 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1111/2208] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:31 2022] POST /identity/v3/projects => generated 405 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:31.936168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:31.946590 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6eef2-a2bf-4a97-9528-1f505ed7dd23 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:32.016998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223269c-b2d7-4511-8e18-7b29b6f8a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:32.017689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223269c-b2d7-4511-8e18-7b29b6f8a7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.018010 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223269c-b2d7-4511-8e18-7b29b6f8a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.018410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223269c-b2d7-4511-8e18-7b29b6f8a7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.019147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223269c-b2d7-4511-8e18-7b29b6f8a7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:32.021175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223269c-b2d7-4511-8e18-7b29b6f8a7a3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:32.051466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1098/2209] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:31 2022] POST /identity/v3/users => generated 303 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:32.053715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3853c81-2d3b-49a3-b49c-d588cfbecf93 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:32.099724 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3853c81-2d3b-49a3-b49c-d588cfbecf93 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:32.107126 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f0ee6-cca9-4385-b07e-6ce4fa71b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:32.107935 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0ee6-cca9-4385-b07e-6ce4fa71b00b admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.108343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0ee6-cca9-4385-b07e-6ce4fa71b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.108713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0ee6-cca9-4385-b07e-6ce4fa71b00b admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.110399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f0ee6-cca9-4385-b07e-6ce4fa71b00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:32.112828 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f0ee6-cca9-4385-b07e-6ce4fa71b00b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:32.136025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1112/2210] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:32.139971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223269c-b2d7-4511-8e18-7b29b6f8a7a3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:32.152414 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223269c-b2d7-4511-8e18-7b29b6f8a7a3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:32.158449 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6ef8f-55fe-47d3-9b9e-797761a587b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:32.159171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6ef8f-55fe-47d3-9b9e-797761a587b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.159450 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6ef8f-55fe-47d3-9b9e-797761a587b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.159720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6ef8f-55fe-47d3-9b9e-797761a587b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.160456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6ef8f-55fe-47d3-9b9e-797761a587b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:32.162074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6ef8f-55fe-47d3-9b9e-797761a587b1 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:32.176189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1099/2211] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:32.181037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f0ee6-cca9-4385-b07e-6ce4fa71b00b admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:32.191864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f0ee6-cca9-4385-b07e-6ce4fa71b00b admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:32.197271 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dcc0c-d951-4b95-bc0f-86c2cfa9f100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:32.198719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dcc0c-d951-4b95-bc0f-86c2cfa9f100 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.199124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dcc0c-d951-4b95-bc0f-86c2cfa9f100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.199471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dcc0c-d951-4b95-bc0f-86c2cfa9f100 admin admin] PATH_INFO: `/v3/projects/f0f1b01444a1424e9553bca093037552/users/45110b947ff74367b2b75022576cf788/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.220283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dcc0c-d951-4b95-bc0f-86c2cfa9f100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f1b01444a1424e9553bca093037552, user_id=45110b947ff74367b2b75022576cf788, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:32.223129 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dcc0c-d951-4b95-bc0f-86c2cfa9f100 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:32.245897 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1113/2212] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:32 2022] PUT /identity/v3/projects/f0f1b01444a1424e9553bca093037552/users/45110b947ff74367b2b75022576cf788/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:32.251180 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352bd2-7e1f-4a5b-b077-abf8541e7cd2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.251473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352bd2-7e1f-4a5b-b077-abf8541e7cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.251808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352bd2-7e1f-4a5b-b077-abf8541e7cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.271152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-d0352bd2-7e1f-4a5b-b077-abf8541e7cd2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:32.272379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d0352bd2-7e1f-4a5b-b077-abf8541e7cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:32.335508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1100/2213] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:32.345005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dcc0c-d951-4b95-bc0f-86c2cfa9f100 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:32.346879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2d1dcc0c-d951-4b95-bc0f-86c2cfa9f100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:32.555655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352bd2-7e1f-4a5b-b077-abf8541e7cd2 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:32.557196 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d0352bd2-7e1f-4a5b-b077-abf8541e7cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:32.558301 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dcc0c-d951-4b95-bc0f-86c2cfa9f100 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:32.562042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e5bd7-5b83-429d-8744-8af0e255f14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:32.562785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e5bd7-5b83-429d-8744-8af0e255f14b service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.563169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e5bd7-5b83-429d-8744-8af0e255f14b service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.563514 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e5bd7-5b83-429d-8744-8af0e255f14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.569807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352bd2-7e1f-4a5b-b077-abf8541e7cd2 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:32.573770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e5bd7-5b83-429d-8744-8af0e255f14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:32.575297 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e5bd7-5b83-429d-8744-8af0e255f14b service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:32.576204 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:32.577277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.577552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.577818 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] PATH_INFO: `/v3/projects/b8d1d02e59774ff099f03aba936bc881` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.579020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d1d02e59774ff099f03aba936bc881)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:32.581965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:32.587299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1114/2214] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:32.638328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d1d02e59774ff099f03aba936bc881', 'request_id': 'req-ff80e31b-6f7d-47ed-b49e-415020108ead'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:32.643917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d1d02e59774ff099f03aba936bc881', 'request_id': 'req-ff80e31b-6f7d-47ed-b49e-415020108ead'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:32.650195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d1d02e59774ff099f03aba936bc881', 'request_id': 'req-ff80e31b-6f7d-47ed-b49e-415020108ead'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:32.668311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] The token cache is being invalidate because project b8d1d02e59774ff099f03aba936bc881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:32.668612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:32.669234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ff80e31b-6f7d-47ed-b49e-415020108ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:32.670955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1101/2215] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:32 2022] DELETE /identity/v3/projects/b8d1d02e59774ff099f03aba936bc881 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:32.677413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9dc40-ee16-4787-b9e9-eff29ec3d07f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.677919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9dc40-ee16-4787-b9e9-eff29ec3d07f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.678206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9dc40-ee16-4787-b9e9-eff29ec3d07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.697899 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-40f9dc40-ee16-4787-b9e9-eff29ec3d07f None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:32.699730 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-40f9dc40-ee16-4787-b9e9-eff29ec3d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:32.760357 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1115/2216] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:32.769460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468021-19d5-410b-9e10-db3c05c3fce5 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.769849 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468021-19d5-410b-9e10-db3c05c3fce5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.770123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468021-19d5-410b-9e10-db3c05c3fce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.792945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-9e468021-19d5-410b-9e10-db3c05c3fce5 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:32.794169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9e468021-19d5-410b-9e10-db3c05c3fce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:32.803523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1102/2217] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:32.808548 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9dc40-ee16-4787-b9e9-eff29ec3d07f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:32.819271 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9dc40-ee16-4787-b9e9-eff29ec3d07f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:32.825831 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc05edc-8fdc-44e2-a8d0-50090dd3b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:32.826544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc05edc-8fdc-44e2-a8d0-50090dd3b1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.826825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc05edc-8fdc-44e2-a8d0-50090dd3b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.827151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc05edc-8fdc-44e2-a8d0-50090dd3b1e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.827867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc05edc-8fdc-44e2-a8d0-50090dd3b1e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:32.828194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc05edc-8fdc-44e2-a8d0-50090dd3b1e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:32.829789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc05edc-8fdc-44e2-a8d0-50090dd3b1e1 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:32.842267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1116/2218] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:32.846585 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e468021-19d5-410b-9e10-db3c05c3fce5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:32.855669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e468021-19d5-410b-9e10-db3c05c3fce5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:32.860316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defca920-7171-42fe-8a10-7534543ac3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:32.860960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca920-7171-42fe-8a10-7534543ac3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.861236 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca920-7171-42fe-8a10-7534543ac3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.861505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca920-7171-42fe-8a10-7534543ac3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.862191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defca920-7171-42fe-8a10-7534543ac3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:32.864149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defca920-7171-42fe-8a10-7534543ac3a3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:32.894196 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1103/2219] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:32 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:32.895364 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc05edc-8fdc-44e2-a8d0-50090dd3b1e1 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:32.908185 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc05edc-8fdc-44e2-a8d0-50090dd3b1e1 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:32.970100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26357f96-f64d-415e-8072-04a7d4eb0008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:32.970766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26357f96-f64d-415e-8072-04a7d4eb0008 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:32.971083 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26357f96-f64d-415e-8072-04a7d4eb0008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:32.971353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26357f96-f64d-415e-8072-04a7d4eb0008 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:32.972054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26357f96-f64d-415e-8072-04a7d4eb0008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:32.973961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26357f96-f64d-415e-8072-04a7d4eb0008 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:32.999796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1117/2220] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:32 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:33.001048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defca920-7171-42fe-8a10-7534543ac3a3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:33.014745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defca920-7171-42fe-8a10-7534543ac3a3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:33.022494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2043d1-d48d-48c8-b145-f2f3afd5f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:33.023277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2043d1-d48d-48c8-b145-f2f3afd5f7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:33.028377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2043d1-d48d-48c8-b145-f2f3afd5f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:33.028742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2043d1-d48d-48c8-b145-f2f3afd5f7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:33.029925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2043d1-d48d-48c8-b145-f2f3afd5f7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:33.033063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2043d1-d48d-48c8-b145-f2f3afd5f7b8 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:33.045908 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1104/2221] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:33.050630 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26357f96-f64d-415e-8072-04a7d4eb0008 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:33.063355 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26357f96-f64d-415e-8072-04a7d4eb0008 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:33.083783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6418-9a5e-4e12-a75c-cca47f94e245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:33.084754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6418-9a5e-4e12-a75c-cca47f94e245 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:33.085131 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6418-9a5e-4e12-a75c-cca47f94e245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:33.085475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6418-9a5e-4e12-a75c-cca47f94e245 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:33.086446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef6418-9a5e-4e12-a75c-cca47f94e245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:33.088248 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef6418-9a5e-4e12-a75c-cca47f94e245 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:33.101934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1118/2222] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:33.106356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2043d1-d48d-48c8-b145-f2f3afd5f7b8 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:33.117909 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2043d1-d48d-48c8-b145-f2f3afd5f7b8 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:33.123321 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0e701-840b-444b-8e73-d63ef4686a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:33.124272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e701-840b-444b-8e73-d63ef4686a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:33.124621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e701-840b-444b-8e73-d63ef4686a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:33.125033 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e701-840b-444b-8e73-d63ef4686a4a admin admin] PATH_INFO: `/v3/projects/e3317ad5ca924929a35cbc31e1da039b/users/1d551387c255421a954b69cf138d3c62/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:33.145058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0e701-840b-444b-8e73-d63ef4686a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3317ad5ca924929a35cbc31e1da039b, user_id=1d551387c255421a954b69cf138d3c62, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:33.147991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0e701-840b-444b-8e73-d63ef4686a4a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:33.178760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1105/2223] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:33 2022] PUT /identity/v3/projects/e3317ad5ca924929a35cbc31e1da039b/users/1d551387c255421a954b69cf138d3c62/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:33.190447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcb194-5328-4f9f-bb7c-b8fe863d05c1 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:33.190855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcb194-5328-4f9f-bb7c-b8fe863d05c1 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:33.191329 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcb194-5328-4f9f-bb7c-b8fe863d05c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:33.224389 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2edcb194-5328-4f9f-bb7c-b8fe863d05c1 None None] MFA Rules not processed for user `1d551387c255421a954b69cf138d3c62`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:33.225602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2edcb194-5328-4f9f-bb7c-b8fe863d05c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:33.328078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1119/2224] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:33.340142 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0e701-840b-444b-8e73-d63ef4686a4a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:33.342124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-bea0e701-840b-444b-8e73-d63ef4686a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:33.427985 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0e701-840b-444b-8e73-d63ef4686a4a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:33.432089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61d566-7b16-4d73-9887-907bf94820a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:33.432228 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61d566-7b16-4d73-9887-907bf94820a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:33.433077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61d566-7b16-4d73-9887-907bf94820a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:33.433350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61d566-7b16-4d73-9887-907bf94820a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:33.459404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61d566-7b16-4d73-9887-907bf94820a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:33.461735 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61d566-7b16-4d73-9887-907bf94820a4 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:33.465772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aba78e-8bf7-4268-812d-9f8b2f6aaf0b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:33.466056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aba78e-8bf7-4268-812d-9f8b2f6aaf0b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:33.466357 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aba78e-8bf7-4268-812d-9f8b2f6aaf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:33.474380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1106/2225] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:33.524698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-61aba78e-8bf7-4268-812d-9f8b2f6aaf0b None None] MFA Rules not processed for user `45110b947ff74367b2b75022576cf788`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:33.526174 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-61aba78e-8bf7-4268-812d-9f8b2f6aaf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:33.629483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1120/2226] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:33.631167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61d566-7b16-4d73-9887-907bf94820a4 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:33.632879 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3c61d566-7b16-4d73-9887-907bf94820a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:33.765452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61d566-7b16-4d73-9887-907bf94820a4 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:33.770829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e30952-01bd-4ecf-b4da-b999012b1fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:33.771545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30952-01bd-4ecf-b4da-b999012b1fea admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:33.771814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30952-01bd-4ecf-b4da-b999012b1fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:33.772122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30952-01bd-4ecf-b4da-b999012b1fea admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:33.772878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e30952-01bd-4ecf-b4da-b999012b1fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:33.774775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e30952-01bd-4ecf-b4da-b999012b1fea admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:33.822949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1107/2227] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:33 2022] POST /identity/v3/projects => generated 405 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:33.825601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aba78e-8bf7-4268-812d-9f8b2f6aaf0b None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:33.846780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aba78e-8bf7-4268-812d-9f8b2f6aaf0b None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:33.913338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ce4c-7978-486a-8ee3-f45ac70906e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:33.914006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ce4c-7978-486a-8ee3-f45ac70906e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:33.914282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ce4c-7978-486a-8ee3-f45ac70906e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:33.914551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ce4c-7978-486a-8ee3-f45ac70906e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:33.915271 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338ce4c-7978-486a-8ee3-f45ac70906e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:33.917768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338ce4c-7978-486a-8ee3-f45ac70906e6 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:33.936710 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1121/2228] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:33 2022] POST /identity/v3/users => generated 309 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:33.940709 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e30952-01bd-4ecf-b4da-b999012b1fea admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:33.953365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e30952-01bd-4ecf-b4da-b999012b1fea admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:33.958087 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac6dd8-0c5e-4e8b-9f93-fdd52b099426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:33.958947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac6dd8-0c5e-4e8b-9f93-fdd52b099426 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:33.959235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac6dd8-0c5e-4e8b-9f93-fdd52b099426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:33.959512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac6dd8-0c5e-4e8b-9f93-fdd52b099426 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:33.960239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac6dd8-0c5e-4e8b-9f93-fdd52b099426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:33.961854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac6dd8-0c5e-4e8b-9f93-fdd52b099426 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:33.973608 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1108/2229] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:33.977688 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ce4c-7978-486a-8ee3-f45ac70906e6 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:33.987897 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ce4c-7978-486a-8ee3-f45ac70906e6 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:33.992661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4448b-f451-46aa-aca7-10df1c30fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:33.993570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4448b-f451-46aa-aca7-10df1c30fb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:33.993851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4448b-f451-46aa-aca7-10df1c30fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:33.994116 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4448b-f451-46aa-aca7-10df1c30fb5f admin admin] PATH_INFO: `/v3/projects/211a3ed7df644aa7b795a0865a5df1b5/users/f0ff6d55bac74f3b832ef066d9b831da/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:34.009152 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4448b-f451-46aa-aca7-10df1c30fb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=211a3ed7df644aa7b795a0865a5df1b5, user_id=f0ff6d55bac74f3b832ef066d9b831da, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:34.011849 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4448b-f451-46aa-aca7-10df1c30fb5f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:34.027230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1122/2230] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:33 2022] PUT /identity/v3/projects/211a3ed7df644aa7b795a0865a5df1b5/users/f0ff6d55bac74f3b832ef066d9b831da/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:34.031305 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac6dd8-0c5e-4e8b-9f93-fdd52b099426 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:34.044148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac6dd8-0c5e-4e8b-9f93-fdd52b099426 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:34.074518 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b40b32-9262-444e-8ca5-f16b290bac53 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:34.074782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b40b32-9262-444e-8ca5-f16b290bac53 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:34.075118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b40b32-9262-444e-8ca5-f16b290bac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:34.098231 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e1b40b32-9262-444e-8ca5-f16b290bac53 None None] MFA Rules not processed for user `b17dd7414b474fcfb8406d11fef7e95d`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:34.099452 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e1b40b32-9262-444e-8ca5-f16b290bac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:34.108859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd13ee-e3c8-44ad-9281-379eff3e0efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:34.109515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd13ee-e3c8-44ad-9281-379eff3e0efa admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:34.109790 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd13ee-e3c8-44ad-9281-379eff3e0efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:34.110059 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd13ee-e3c8-44ad-9281-379eff3e0efa admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:34.110799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd13ee-e3c8-44ad-9281-379eff3e0efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:34.112501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd13ee-e3c8-44ad-9281-379eff3e0efa admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:34.125926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1109/2231] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:34.126636 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd13ee-e3c8-44ad-9281-379eff3e0efa admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:34.137574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd13ee-e3c8-44ad-9281-379eff3e0efa admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:34.144550 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442be60-a142-472c-bfdd-82c82c49ba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:34.145452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442be60-a142-472c-bfdd-82c82c49ba45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:34.145725 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442be60-a142-472c-bfdd-82c82c49ba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:34.145991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442be60-a142-472c-bfdd-82c82c49ba45 admin admin] PATH_INFO: `/v3/projects/211a3ed7df644aa7b795a0865a5df1b5/users/f0ff6d55bac74f3b832ef066d9b831da/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:34.148009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442be60-a142-472c-bfdd-82c82c49ba45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=211a3ed7df644aa7b795a0865a5df1b5, user_id=f0ff6d55bac74f3b832ef066d9b831da, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:34.150632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442be60-a142-472c-bfdd-82c82c49ba45 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:34.160500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1123/2232] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:34.162955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1110/2233] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:34 2022] PUT /identity/v3/projects/211a3ed7df644aa7b795a0865a5df1b5/users/f0ff6d55bac74f3b832ef066d9b831da/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:35.185721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb346-86cb-4960-9c92-785b42ac2a5c None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:35.186283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb346-86cb-4960-9c92-785b42ac2a5c None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:35.186283 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb346-86cb-4960-9c92-785b42ac2a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:35.228098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6bdeb346-86cb-4960-9c92-785b42ac2a5c None None] MFA Rules not processed for user `f0ff6d55bac74f3b832ef066d9b831da`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:35.230225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6bdeb346-86cb-4960-9c92-785b42ac2a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:35.363662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1124/2234] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:36.669703 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442be60-a142-472c-bfdd-82c82c49ba45 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:36.737218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442be60-a142-472c-bfdd-82c82c49ba45 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:36.741991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:36.742865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:36.743176 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:36.743445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] PATH_INFO: `/v3/users/45110b947ff74367b2b75022576cf788` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:36.744613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=45110b947ff74367b2b75022576cf788)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:36.747225 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:36.795424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45110b947ff74367b2b75022576cf788'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:36.796098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45110b947ff74367b2b75022576cf788'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:36.809617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45110b947ff74367b2b75022576cf788'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:36.817232 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45110b947ff74367b2b75022576cf788'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:36.826703 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45110b947ff74367b2b75022576cf788'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:36.833220 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1111/2235] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:36 2022] DELETE /identity/v3/users/45110b947ff74367b2b75022576cf788 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:37.004579 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeb346-86cb-4960-9c92-785b42ac2a5c None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.016673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeb346-86cb-4960-9c92-785b42ac2a5c None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.075768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.076537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.077279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.077560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] PATH_INFO: `/v3/projects/f0f1b01444a1424e9553bca093037552` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.078771 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f1b01444a1424e9553bca093037552)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.080888 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.130608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f1b01444a1424e9553bca093037552', 'request_id': 'req-32a95ab2-e942-4a09-8b70-34b1f6c1704b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.136378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f1b01444a1424e9553bca093037552', 'request_id': 'req-32a95ab2-e942-4a09-8b70-34b1f6c1704b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.142466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f1b01444a1424e9553bca093037552', 'request_id': 'req-32a95ab2-e942-4a09-8b70-34b1f6c1704b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.155007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] The token cache is being invalidate because project f0f1b01444a1424e9553bca093037552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:37.155317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.155927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.157726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1125/2236] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:37 2022] DELETE /identity/v3/projects/f0f1b01444a1424e9553bca093037552 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:37.161617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.163101 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:37.177262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04aa3e7-f54e-4a97-a947-9983ffa44e0a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.235958 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e313a-0a4a-4198-a771-952c9bbc4099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.236829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e313a-0a4a-4198-a771-952c9bbc4099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.237111 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e313a-0a4a-4198-a771-952c9bbc4099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.237379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e313a-0a4a-4198-a771-952c9bbc4099 admin admin] PATH_INFO: `/v3/users/f0ff6d55bac74f3b832ef066d9b831da` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.238575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e313a-0a4a-4198-a771-952c9bbc4099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ff6d55bac74f3b832ef066d9b831da)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.240542 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e313a-0a4a-4198-a771-952c9bbc4099 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.284820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-550e313a-0a4a-4198-a771-952c9bbc4099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ff6d55bac74f3b832ef066d9b831da'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.285471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-550e313a-0a4a-4198-a771-952c9bbc4099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ff6d55bac74f3b832ef066d9b831da'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.298432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-550e313a-0a4a-4198-a771-952c9bbc4099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ff6d55bac74f3b832ef066d9b831da'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.306108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-550e313a-0a4a-4198-a771-952c9bbc4099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ff6d55bac74f3b832ef066d9b831da'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.313878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-550e313a-0a4a-4198-a771-952c9bbc4099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ff6d55bac74f3b832ef066d9b831da'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.320153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1112/2237] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:37 2022] DELETE /identity/v3/users/f0ff6d55bac74f3b832ef066d9b831da => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:37.589527 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.591038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:37.603472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a95ab2-e942-4a09-8b70-34b1f6c1704b admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.675340 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.676275 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.676611 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.676912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] PATH_INFO: `/v3/projects/211a3ed7df644aa7b795a0865a5df1b5` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.678112 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] RBAC: Authorizing `identity:delete_project(project_id=211a3ed7df644aa7b795a0865a5df1b5)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.680041 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.736855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211a3ed7df644aa7b795a0865a5df1b5', 'request_id': 'req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.742176 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211a3ed7df644aa7b795a0865a5df1b5', 'request_id': 'req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.748651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211a3ed7df644aa7b795a0865a5df1b5', 'request_id': 'req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.762334 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] The token cache is being invalidate because project 211a3ed7df644aa7b795a0865a5df1b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:37.762621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.763265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-cf952ad9-bfc9-4c9b-a4ac-f4121154187b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.765006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1126/2238] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:37 2022] DELETE /identity/v3/projects/211a3ed7df644aa7b795a0865a5df1b5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:37.769801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92085176-27c0-4e71-ab80-1f7dc8050bbb None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.770292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92085176-27c0-4e71-ab80-1f7dc8050bbb None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.770372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92085176-27c0-4e71-ab80-1f7dc8050bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.789617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-92085176-27c0-4e71-ab80-1f7dc8050bbb None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:37.790798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-92085176-27c0-4e71-ab80-1f7dc8050bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:37.854565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1113/2239] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:37.863123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99733ab-900d-4624-b943-a94b24693644 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.863324 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99733ab-900d-4624-b943-a94b24693644 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.863856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99733ab-900d-4624-b943-a94b24693644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.883763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-d99733ab-900d-4624-b943-a94b24693644 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:37.884979 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d99733ab-900d-4624-b943-a94b24693644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:37.894459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1127/2240] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:37.898600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92085176-27c0-4e71-ab80-1f7dc8050bbb None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.908237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92085176-27c0-4e71-ab80-1f7dc8050bbb None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.912767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208975c-a7ff-40f2-906c-0b201be2a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.913410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208975c-a7ff-40f2-906c-0b201be2a0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.913689 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208975c-a7ff-40f2-906c-0b201be2a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.913958 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208975c-a7ff-40f2-906c-0b201be2a0e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.914667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208975c-a7ff-40f2-906c-0b201be2a0e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:37.914998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208975c-a7ff-40f2-906c-0b201be2a0e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.917093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208975c-a7ff-40f2-906c-0b201be2a0e3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.928291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1114/2241] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:37.933335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99733ab-900d-4624-b943-a94b24693644 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.942177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99733ab-900d-4624-b943-a94b24693644 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.946651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96655113-58e3-4ce3-9ae6-03da84c2faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.947312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96655113-58e3-4ce3-9ae6-03da84c2faac admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.947592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96655113-58e3-4ce3-9ae6-03da84c2faac admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.947863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96655113-58e3-4ce3-9ae6-03da84c2faac admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.948547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96655113-58e3-4ce3-9ae6-03da84c2faac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.950397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96655113-58e3-4ce3-9ae6-03da84c2faac admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.973805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1128/2242] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:37 2022] POST /identity/v3/projects => generated 379 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:37.977798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208975c-a7ff-40f2-906c-0b201be2a0e3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.987879 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208975c-a7ff-40f2-906c-0b201be2a0e3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.040466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63deda-8f8f-4cda-97c1-3c3bdc1c3473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.041110 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63deda-8f8f-4cda-97c1-3c3bdc1c3473 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.041389 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63deda-8f8f-4cda-97c1-3c3bdc1c3473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.042198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63deda-8f8f-4cda-97c1-3c3bdc1c3473 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.042879 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63deda-8f8f-4cda-97c1-3c3bdc1c3473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:38.044795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63deda-8f8f-4cda-97c1-3c3bdc1c3473 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:38.066922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1115/2243] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:37 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:38.070991 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96655113-58e3-4ce3-9ae6-03da84c2faac admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:38.081044 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96655113-58e3-4ce3-9ae6-03da84c2faac admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.086031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52361-8e99-414d-b109-9e131094fbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.086226 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52361-8e99-414d-b109-9e131094fbde admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.086501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52361-8e99-414d-b109-9e131094fbde admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.086767 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52361-8e99-414d-b109-9e131094fbde admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.087527 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d52361-8e99-414d-b109-9e131094fbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:38.089106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d52361-8e99-414d-b109-9e131094fbde admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:38.099416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1129/2244] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:38.103298 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63deda-8f8f-4cda-97c1-3c3bdc1c3473 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:38.113562 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63deda-8f8f-4cda-97c1-3c3bdc1c3473 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.118097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a7caa-f20a-4fa4-8270-ba9bcd951066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.118734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a7caa-f20a-4fa4-8270-ba9bcd951066 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.119075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a7caa-f20a-4fa4-8270-ba9bcd951066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.119352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a7caa-f20a-4fa4-8270-ba9bcd951066 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.120739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a7caa-f20a-4fa4-8270-ba9bcd951066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:38.122314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a7caa-f20a-4fa4-8270-ba9bcd951066 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:38.132145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1116/2245] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:38.136027 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52361-8e99-414d-b109-9e131094fbde admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:38.145484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52361-8e99-414d-b109-9e131094fbde admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.149970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505f474-56fd-43bc-a9a5-557e659d8d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.150817 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f474-56fd-43bc-a9a5-557e659d8d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.151123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f474-56fd-43bc-a9a5-557e659d8d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.151389 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f474-56fd-43bc-a9a5-557e659d8d01 admin admin] PATH_INFO: `/v3/projects/8767d9df6ef54e68b290dfda51cde040/users/79a4763f6e3e4b51bbebc4d1c00cc327/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.165066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505f474-56fd-43bc-a9a5-557e659d8d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8767d9df6ef54e68b290dfda51cde040, user_id=79a4763f6e3e4b51bbebc4d1c00cc327, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:38.168218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505f474-56fd-43bc-a9a5-557e659d8d01 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:38.180593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1130/2246] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:38 2022] PUT /identity/v3/projects/8767d9df6ef54e68b290dfda51cde040/users/79a4763f6e3e4b51bbebc4d1c00cc327/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:38.191222 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b86a25-9b90-4927-9cb3-10d7a992f80e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.191511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b86a25-9b90-4927-9cb3-10d7a992f80e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.191782 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b86a25-9b90-4927-9cb3-10d7a992f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.217142 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-f6b86a25-9b90-4927-9cb3-10d7a992f80e None None] MFA Rules not processed for user `79a4763f6e3e4b51bbebc4d1c00cc327`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:38.218325 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f6b86a25-9b90-4927-9cb3-10d7a992f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:38.280108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1117/2247] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:38.284393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505f474-56fd-43bc-a9a5-557e659d8d01 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:38.342506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505f474-56fd-43bc-a9a5-557e659d8d01 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.347192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676b64-e0f9-4925-80ec-eda2ecffa776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.347824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676b64-e0f9-4925-80ec-eda2ecffa776 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.348108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676b64-e0f9-4925-80ec-eda2ecffa776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.348372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676b64-e0f9-4925-80ec-eda2ecffa776 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.349057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab676b64-e0f9-4925-80ec-eda2ecffa776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:38.350949 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab676b64-e0f9-4925-80ec-eda2ecffa776 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:38.374967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1131/2248] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:38 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:38.378844 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b86a25-9b90-4927-9cb3-10d7a992f80e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:38.390186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b86a25-9b90-4927-9cb3-10d7a992f80e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.443144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a3e9d-fbd3-401c-8ac0-c432b1c1f6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.443788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a3e9d-fbd3-401c-8ac0-c432b1c1f6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.444063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a3e9d-fbd3-401c-8ac0-c432b1c1f6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.444337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a3e9d-fbd3-401c-8ac0-c432b1c1f6d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.445019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a3e9d-fbd3-401c-8ac0-c432b1c1f6d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:38.446936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a3e9d-fbd3-401c-8ac0-c432b1c1f6d3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:38.466673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1118/2249] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:38 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:38.470326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676b64-e0f9-4925-80ec-eda2ecffa776 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:38.480634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676b64-e0f9-4925-80ec-eda2ecffa776 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.485485 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4e335-974e-46c7-9e8a-607fbfd6cd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.486213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4e335-974e-46c7-9e8a-607fbfd6cd6f admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.486495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4e335-974e-46c7-9e8a-607fbfd6cd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.486768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4e335-974e-46c7-9e8a-607fbfd6cd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.487524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4e335-974e-46c7-9e8a-607fbfd6cd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:38.489093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4e335-974e-46c7-9e8a-607fbfd6cd6f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:38.506353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1132/2250] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:38.511374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a3e9d-fbd3-401c-8ac0-c432b1c1f6d3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:38.521261 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a3e9d-fbd3-401c-8ac0-c432b1c1f6d3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.525847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10efed-47dc-4855-8552-7e4158b2ca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.526711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10efed-47dc-4855-8552-7e4158b2ca06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.527017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10efed-47dc-4855-8552-7e4158b2ca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.527287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10efed-47dc-4855-8552-7e4158b2ca06 admin admin] PATH_INFO: `/v3/projects/d221bde42d6c4976ba58db72bac1afdb/users/9130e9be3151445b985aebb0fd24881f/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.541353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10efed-47dc-4855-8552-7e4158b2ca06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d221bde42d6c4976ba58db72bac1afdb, user_id=9130e9be3151445b985aebb0fd24881f, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:38.544047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10efed-47dc-4855-8552-7e4158b2ca06 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:38.556859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1119/2251] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:38 2022] PUT /identity/v3/projects/d221bde42d6c4976ba58db72bac1afdb/users/9130e9be3151445b985aebb0fd24881f/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:38.561252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4e335-974e-46c7-9e8a-607fbfd6cd6f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:38.571151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4e335-974e-46c7-9e8a-607fbfd6cd6f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.625333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c358bb0-1a68-4df9-bbd4-e22897eeef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.625915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c358bb0-1a68-4df9-bbd4-e22897eeef61 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.626192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c358bb0-1a68-4df9-bbd4-e22897eeef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.626462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c358bb0-1a68-4df9-bbd4-e22897eeef61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.627197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c358bb0-1a68-4df9-bbd4-e22897eeef61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:38.628765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c358bb0-1a68-4df9-bbd4-e22897eeef61 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:38.639066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1133/2252] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:38.642956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10efed-47dc-4855-8552-7e4158b2ca06 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:38.654854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10efed-47dc-4855-8552-7e4158b2ca06 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.659676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a3a5-4c47-4a15-9455-1f7f4e59e327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.660577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a3a5-4c47-4a15-9455-1f7f4e59e327 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.660856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a3a5-4c47-4a15-9455-1f7f4e59e327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.661152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a3a5-4c47-4a15-9455-1f7f4e59e327 admin admin] PATH_INFO: `/v3/projects/d221bde42d6c4976ba58db72bac1afdb/users/9130e9be3151445b985aebb0fd24881f/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.663179 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3a3a5-4c47-4a15-9455-1f7f4e59e327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d221bde42d6c4976ba58db72bac1afdb, user_id=9130e9be3151445b985aebb0fd24881f, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:38.665843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3a3a5-4c47-4a15-9455-1f7f4e59e327 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:38.676836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1120/2253] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:38 2022] PUT /identity/v3/projects/d221bde42d6c4976ba58db72bac1afdb/users/9130e9be3151445b985aebb0fd24881f/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:38.688610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c910f-c7f8-44e9-b47e-3296e3c736d6 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.688896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c910f-c7f8-44e9-b47e-3296e3c736d6 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.689169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c910f-c7f8-44e9-b47e-3296e3c736d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.715887 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f21c910f-c7f8-44e9-b47e-3296e3c736d6 None None] MFA Rules not processed for user `9130e9be3151445b985aebb0fd24881f`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:38.717105 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f21c910f-c7f8-44e9-b47e-3296e3c736d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:38.787854 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1134/2254] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:38.799638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a3a5-4c47-4a15-9455-1f7f4e59e327 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:38.801384 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b1a3a3a5-4c47-4a15-9455-1f7f4e59e327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:38.860200 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a3a5-4c47-4a15-9455-1f7f4e59e327 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.864083 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b6f8a-617e-414d-9a42-e803caa774a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.865146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b6f8a-617e-414d-9a42-e803caa774a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.865146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b6f8a-617e-414d-9a42-e803caa774a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.865320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b6f8a-617e-414d-9a42-e803caa774a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:38.875180 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b6f8a-617e-414d-9a42-e803caa774a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:38.876821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b6f8a-617e-414d-9a42-e803caa774a4 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:38.888023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1121/2255] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:38.970717 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c910f-c7f8-44e9-b47e-3296e3c736d6 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:38.980683 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c910f-c7f8-44e9-b47e-3296e3c736d6 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:38.984348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904cf57-8361-4353-8255-f4b5f7c10bac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:38.984982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904cf57-8361-4353-8255-f4b5f7c10bac service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:38.985261 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904cf57-8361-4353-8255-f4b5f7c10bac service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:38.985533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904cf57-8361-4353-8255-f4b5f7c10bac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:39.042217 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904cf57-8361-4353-8255-f4b5f7c10bac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:39.043681 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904cf57-8361-4353-8255-f4b5f7c10bac service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:39.052899 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1135/2256] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:51.463048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52fcfa-13c7-423c-aaac-29c0678e3425 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:51.463558 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52fcfa-13c7-423c-aaac-29c0678e3425 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:51.463648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52fcfa-13c7-423c-aaac-29c0678e3425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:51.482349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-8b52fcfa-13c7-423c-aaac-29c0678e3425 None None] MFA Rules not processed for user `2d4da73ac92b47f4b9d4b393dea47d64`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:51.483701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-8b52fcfa-13c7-423c-aaac-29c0678e3425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:51.539647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1122/2257] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:39:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:01.584723 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904cf57-8361-4353-8255-f4b5f7c10bac service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:01.647394 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904cf57-8361-4353-8255-f4b5f7c10bac service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:01.651996 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:01.652925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.653193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.653462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] PATH_INFO: `/v3/users/79a4763f6e3e4b51bbebc4d1c00cc327` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.654651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a4763f6e3e4b51bbebc4d1c00cc327)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:01.656646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:01.702329 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a4763f6e3e4b51bbebc4d1c00cc327'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.703006 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a4763f6e3e4b51bbebc4d1c00cc327'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.703644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a4763f6e3e4b51bbebc4d1c00cc327'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.716777 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a4763f6e3e4b51bbebc4d1c00cc327'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.727093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a4763f6e3e4b51bbebc4d1c00cc327'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.741659 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1136/2258] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:40:01 2022] DELETE /identity/v3/users/79a4763f6e3e4b51bbebc4d1c00cc327 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:01.746737 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9c263-8678-4ad4-a3ed-8f5ea02983b3 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.747605 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9c263-8678-4ad4-a3ed-8f5ea02983b3 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.747605 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9c263-8678-4ad4-a3ed-8f5ea02983b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.771997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-24a9c263-8678-4ad4-a3ed-8f5ea02983b3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:01.771997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-24a9c263-8678-4ad4-a3ed-8f5ea02983b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:01.832328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1123/2259] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:40:01.842144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:01.844161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:01.902573 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775eb82-0d55-4919-8039-9f414b594b0a admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:01.906304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b58bff-4915-4043-94fa-07a409f022c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:01.907007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b58bff-4915-4043-94fa-07a409f022c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.907288 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b58bff-4915-4043-94fa-07a409f022c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.907564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b58bff-4915-4043-94fa-07a409f022c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.917385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b58bff-4915-4043-94fa-07a409f022c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:01.918744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b58bff-4915-4043-94fa-07a409f022c5 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:01.927932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1137/2260] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:40:02.194649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9c263-8678-4ad4-a3ed-8f5ea02983b3 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:02.196152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-24a9c263-8678-4ad4-a3ed-8f5ea02983b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:02.208822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9c263-8678-4ad4-a3ed-8f5ea02983b3 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:02.214182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:02.215119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.215468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.215822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] PATH_INFO: `/v3/projects/8767d9df6ef54e68b290dfda51cde040` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.217084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8767d9df6ef54e68b290dfda51cde040)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:02.219180 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:02.270761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8767d9df6ef54e68b290dfda51cde040', 'request_id': 'req-56442d68-35c9-461b-871b-6ba4978d49e6'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.280729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8767d9df6ef54e68b290dfda51cde040', 'request_id': 'req-56442d68-35c9-461b-871b-6ba4978d49e6'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.287204 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8767d9df6ef54e68b290dfda51cde040', 'request_id': 'req-56442d68-35c9-461b-871b-6ba4978d49e6'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.299750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] The token cache is being invalidate because project 8767d9df6ef54e68b290dfda51cde040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:40:02.300139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.300666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.302390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1124/2261] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:40:02 2022] DELETE /identity/v3/projects/8767d9df6ef54e68b290dfda51cde040 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:02.306042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b58bff-4915-4043-94fa-07a409f022c5 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:02.316760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b58bff-4915-4043-94fa-07a409f022c5 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:02.386581 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8353b5b-7a49-4ecb-a929-5785187cfaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:02.387479 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8353b5b-7a49-4ecb-a929-5785187cfaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.387753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8353b5b-7a49-4ecb-a929-5785187cfaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.388020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8353b5b-7a49-4ecb-a929-5785187cfaf7 admin admin] PATH_INFO: `/v3/users/9130e9be3151445b985aebb0fd24881f` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.389191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8353b5b-7a49-4ecb-a929-5785187cfaf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9130e9be3151445b985aebb0fd24881f)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:02.391207 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8353b5b-7a49-4ecb-a929-5785187cfaf7 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:02.445937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e8353b5b-7a49-4ecb-a929-5785187cfaf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9130e9be3151445b985aebb0fd24881f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.446605 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e8353b5b-7a49-4ecb-a929-5785187cfaf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9130e9be3151445b985aebb0fd24881f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.447402 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e8353b5b-7a49-4ecb-a929-5785187cfaf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9130e9be3151445b985aebb0fd24881f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.459716 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e8353b5b-7a49-4ecb-a929-5785187cfaf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9130e9be3151445b985aebb0fd24881f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.467479 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-e8353b5b-7a49-4ecb-a929-5785187cfaf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9130e9be3151445b985aebb0fd24881f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.480485 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1138/2262] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:40:02 2022] DELETE /identity/v3/users/9130e9be3151445b985aebb0fd24881f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:02.775483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:02.777060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:02.791865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56442d68-35c9-461b-871b-6ba4978d49e6 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:02.849239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:02.850127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.850410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.850683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] PATH_INFO: `/v3/projects/d221bde42d6c4976ba58db72bac1afdb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.851900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d221bde42d6c4976ba58db72bac1afdb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:02.854348 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:02.904161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd221bde42d6c4976ba58db72bac1afdb', 'request_id': 'req-32173a25-2d43-494a-a063-afdc51e7b65a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.909626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd221bde42d6c4976ba58db72bac1afdb', 'request_id': 'req-32173a25-2d43-494a-a063-afdc51e7b65a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.916162 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd221bde42d6c4976ba58db72bac1afdb', 'request_id': 'req-32173a25-2d43-494a-a063-afdc51e7b65a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.928615 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] The token cache is being invalidate because project d221bde42d6c4976ba58db72bac1afdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:40:02.928902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.929517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-32173a25-2d43-494a-a063-afdc51e7b65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.931397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1125/2263] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:40:02 2022] DELETE /identity/v3/projects/d221bde42d6c4976ba58db72bac1afdb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:02.937086 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ccbe5-1044-40c9-9187-dc22a57810dd None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.937538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ccbe5-1044-40c9-9187-dc22a57810dd None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.937732 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ccbe5-1044-40c9-9187-dc22a57810dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.956354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-8f1ccbe5-1044-40c9-9187-dc22a57810dd None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:02.957561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8f1ccbe5-1044-40c9-9187-dc22a57810dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:03.015387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1139/2264] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:03.023495 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa6352-9f09-4c1b-a75b-cb26c0ddfaf0 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:03.023780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa6352-9f09-4c1b-a75b-cb26c0ddfaf0 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:03.024058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa6352-9f09-4c1b-a75b-cb26c0ddfaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:03.042990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-78fa6352-9f09-4c1b-a75b-cb26c0ddfaf0 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:03.044127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-78fa6352-9f09-4c1b-a75b-cb26c0ddfaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:03.051959 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1126/2265] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:03.056103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ccbe5-1044-40c9-9187-dc22a57810dd None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:03.066229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ccbe5-1044-40c9-9187-dc22a57810dd None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:03.071151 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63e5c1-e5f2-4161-a1bc-8a922bae0bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:03.072019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63e5c1-e5f2-4161-a1bc-8a922bae0bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:03.072296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63e5c1-e5f2-4161-a1bc-8a922bae0bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:03.072652 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63e5c1-e5f2-4161-a1bc-8a922bae0bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:03.073462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63e5c1-e5f2-4161-a1bc-8a922bae0bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:40:03.073768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63e5c1-e5f2-4161-a1bc-8a922bae0bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:03.075608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63e5c1-e5f2-4161-a1bc-8a922bae0bb4 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:03.088791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1140/2266] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:40:03.092945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa6352-9f09-4c1b-a75b-cb26c0ddfaf0 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:03.102097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa6352-9f09-4c1b-a75b-cb26c0ddfaf0 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:03.107465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d7059-c2b6-4d10-a894-ede73772d721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:03.108109 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d7059-c2b6-4d10-a894-ede73772d721 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:03.108389 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d7059-c2b6-4d10-a894-ede73772d721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:03.108666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d7059-c2b6-4d10-a894-ede73772d721 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:03.109355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d7059-c2b6-4d10-a894-ede73772d721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:03.111407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d7059-c2b6-4d10-a894-ede73772d721 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:03.138378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1127/2267] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:40:03 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:40:03.142506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63e5c1-e5f2-4161-a1bc-8a922bae0bb4 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:03.152905 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63e5c1-e5f2-4161-a1bc-8a922bae0bb4 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:03.208562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac78ca2-1e07-429b-927f-5cb7d8496075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:03.209225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac78ca2-1e07-429b-927f-5cb7d8496075 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:03.209501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac78ca2-1e07-429b-927f-5cb7d8496075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:03.209769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac78ca2-1e07-429b-927f-5cb7d8496075 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:03.210455 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac78ca2-1e07-429b-927f-5cb7d8496075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:03.212397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac78ca2-1e07-429b-927f-5cb7d8496075 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:03.232205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1141/2268] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:40:03 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:40:03.236373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d7059-c2b6-4d10-a894-ede73772d721 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:03.246275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d7059-c2b6-4d10-a894-ede73772d721 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:03.250761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5368c-15bc-47d0-8c14-5c3ace7369a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:03.251430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5368c-15bc-47d0-8c14-5c3ace7369a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:03.251705 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5368c-15bc-47d0-8c14-5c3ace7369a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:03.251973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5368c-15bc-47d0-8c14-5c3ace7369a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:03.252683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5368c-15bc-47d0-8c14-5c3ace7369a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:03.254255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5368c-15bc-47d0-8c14-5c3ace7369a5 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:03.264550 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1128/2269] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:40:03.268289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac78ca2-1e07-429b-927f-5cb7d8496075 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:03.278317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac78ca2-1e07-429b-927f-5cb7d8496075 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:03.282848 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6837fe-1c33-491e-811d-474630549e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:03.283569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6837fe-1c33-491e-811d-474630549e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:03.283856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6837fe-1c33-491e-811d-474630549e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:03.284129 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6837fe-1c33-491e-811d-474630549e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:03.284844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6837fe-1c33-491e-811d-474630549e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:03.286418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6837fe-1c33-491e-811d-474630549e8b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:03.296625 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1142/2270] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:40:03.300530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5368c-15bc-47d0-8c14-5c3ace7369a5 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:03.310136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5368c-15bc-47d0-8c14-5c3ace7369a5 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:03.314609 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169f73c-1617-495b-9766-bacada0156b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:03.315487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169f73c-1617-495b-9766-bacada0156b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:03.315761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169f73c-1617-495b-9766-bacada0156b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:03.316029 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169f73c-1617-495b-9766-bacada0156b7 admin admin] PATH_INFO: `/v3/projects/d2893b07a4564b0885439092f15bfdfb/users/bd6237f9dc0f44a293bd1346dc182325/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:03.329625 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169f73c-1617-495b-9766-bacada0156b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2893b07a4564b0885439092f15bfdfb, user_id=bd6237f9dc0f44a293bd1346dc182325, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:03.332570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169f73c-1617-495b-9766-bacada0156b7 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:03.346561 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1129/2271] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:40:03 2022] PUT /identity/v3/projects/d2893b07a4564b0885439092f15bfdfb/users/bd6237f9dc0f44a293bd1346dc182325/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:40:03.358119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f954732-bc2b-4d6c-8171-03caa8ed1fd9 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:03.358408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f954732-bc2b-4d6c-8171-03caa8ed1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:03.358729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f954732-bc2b-4d6c-8171-03caa8ed1fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:03.385631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-5f954732-bc2b-4d6c-8171-03caa8ed1fd9 None None] MFA Rules not processed for user `bd6237f9dc0f44a293bd1346dc182325`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:03.386858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5f954732-bc2b-4d6c-8171-03caa8ed1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:03.450132 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1143/2272] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:40:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:03.460920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169f73c-1617-495b-9766-bacada0156b7 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:03.463217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9169f73c-1617-495b-9766-bacada0156b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:03.519349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169f73c-1617-495b-9766-bacada0156b7 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:03.523098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9482ce1-9f5e-4ef7-9ea4-6da3fa3f9ef7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ad61a348b2450baceb030f98150647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:03.523729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482ce1-9f5e-4ef7-9ea4-6da3fa3f9ef7 service glance] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:03.524005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482ce1-9f5e-4ef7-9ea4-6da3fa3f9ef7 service glance] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:03.524272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482ce1-9f5e-4ef7-9ea4-6da3fa3f9ef7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:03.533239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9482ce1-9f5e-4ef7-9ea4-6da3fa3f9ef7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:03.534658 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9482ce1-9f5e-4ef7-9ea4-6da3fa3f9ef7 service glance] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:03.543456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1130/2273] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:40:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:40:30.762982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f954732-bc2b-4d6c-8171-03caa8ed1fd9 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:30.765053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5f954732-bc2b-4d6c-8171-03caa8ed1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:30.868818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f954732-bc2b-4d6c-8171-03caa8ed1fd9 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:30.874187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:30.874722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:30.875030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:30.875296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] PATH_INFO: `/v3/users/1d551387c255421a954b69cf138d3c62` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:30.876475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d551387c255421a954b69cf138d3c62)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:30.878582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:30.925254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d551387c255421a954b69cf138d3c62'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:30.925904 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d551387c255421a954b69cf138d3c62'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:30.926500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d551387c255421a954b69cf138d3c62'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:30.938251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d551387c255421a954b69cf138d3c62'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:30.945539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d551387c255421a954b69cf138d3c62'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:30.958547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1144/2274] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:40:30 2022] DELETE /identity/v3/users/1d551387c255421a954b69cf138d3c62 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:30.963341 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103685f-c09f-4c59-b6ea-4ae9e6bc3ecc None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:30.963859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103685f-c09f-4c59-b6ea-4ae9e6bc3ecc None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:30.963859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103685f-c09f-4c59-b6ea-4ae9e6bc3ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:30.991350 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-2103685f-c09f-4c59-b6ea-4ae9e6bc3ecc None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:30.992643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-2103685f-c09f-4c59-b6ea-4ae9e6bc3ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:31.053759 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1131/2275] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:31.067779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:31.069343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:31.167300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cce10f-c125-4b34-8595-a3430078b65d admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:31.171497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a935da2-f133-4f52-b615-a06003c8451d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:31.172129 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935da2-f133-4f52-b615-a06003c8451d service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:31.172405 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935da2-f133-4f52-b615-a06003c8451d service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:31.172677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935da2-f133-4f52-b615-a06003c8451d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:31.181463 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a935da2-f133-4f52-b615-a06003c8451d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:31.182869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a935da2-f133-4f52-b615-a06003c8451d service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:31.193315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1145/2276] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:40:31.462102 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103685f-c09f-4c59-b6ea-4ae9e6bc3ecc None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:31.463725 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-2103685f-c09f-4c59-b6ea-4ae9e6bc3ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:31.476864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103685f-c09f-4c59-b6ea-4ae9e6bc3ecc None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:31.481923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:31.483503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:31.483805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:31.484075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] PATH_INFO: `/v3/projects/e3317ad5ca924929a35cbc31e1da039b` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:31.485313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3317ad5ca924929a35cbc31e1da039b)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:31.487596 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:31.536123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3317ad5ca924929a35cbc31e1da039b', 'request_id': 'req-5afd94c5-3d26-499f-84fb-275f5f858f36'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:31.541408 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3317ad5ca924929a35cbc31e1da039b', 'request_id': 'req-5afd94c5-3d26-499f-84fb-275f5f858f36'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:31.548151 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3317ad5ca924929a35cbc31e1da039b', 'request_id': 'req-5afd94c5-3d26-499f-84fb-275f5f858f36'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:31.561499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] The token cache is being invalidate because project e3317ad5ca924929a35cbc31e1da039b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:40:31.561786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:31.562514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5afd94c5-3d26-499f-84fb-275f5f858f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:31.564099 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1132/2277] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:40:31 2022] DELETE /identity/v3/projects/e3317ad5ca924929a35cbc31e1da039b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:31.568994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae2c38-aab5-4201-9986-5b31bf419014 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:31.569276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae2c38-aab5-4201-9986-5b31bf419014 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:31.569548 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae2c38-aab5-4201-9986-5b31bf419014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:31.597726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e2ae2c38-aab5-4201-9986-5b31bf419014 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:31.598946 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e2ae2c38-aab5-4201-9986-5b31bf419014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:31.656262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1146/2278] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:31.663446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4271f-28c0-4bea-a627-cd127ac66534 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:31.663765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4271f-28c0-4bea-a627-cd127ac66534 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:31.663993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4271f-28c0-4bea-a627-cd127ac66534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:31.684283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-bec4271f-28c0-4bea-a627-cd127ac66534 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:31.685533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-bec4271f-28c0-4bea-a627-cd127ac66534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:31.693478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1133/2279] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:31.697683 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae2c38-aab5-4201-9986-5b31bf419014 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:31.707302 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae2c38-aab5-4201-9986-5b31bf419014 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:31.711909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490f7eb-6ac4-4fa6-a7e9-04a215b7c6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:31.712562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490f7eb-6ac4-4fa6-a7e9-04a215b7c6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:31.712844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490f7eb-6ac4-4fa6-a7e9-04a215b7c6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:31.713121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490f7eb-6ac4-4fa6-a7e9-04a215b7c6e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:31.713842 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490f7eb-6ac4-4fa6-a7e9-04a215b7c6e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:40:31.714150 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490f7eb-6ac4-4fa6-a7e9-04a215b7c6e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:31.715771 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490f7eb-6ac4-4fa6-a7e9-04a215b7c6e4 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:31.727875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1147/2280] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:40:31.732114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4271f-28c0-4bea-a627-cd127ac66534 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:31.741662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4271f-28c0-4bea-a627-cd127ac66534 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:31.746242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69a04b-2d6b-4abd-a6b7-27af656223a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:31.746878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a04b-2d6b-4abd-a6b7-27af656223a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:31.747183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a04b-2d6b-4abd-a6b7-27af656223a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:31.747453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a04b-2d6b-4abd-a6b7-27af656223a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:31.748513 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69a04b-2d6b-4abd-a6b7-27af656223a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:31.750074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69a04b-2d6b-4abd-a6b7-27af656223a8 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:31.776843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1134/2281] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:40:31 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:40:31.781666 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490f7eb-6ac4-4fa6-a7e9-04a215b7c6e4 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:31.791616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490f7eb-6ac4-4fa6-a7e9-04a215b7c6e4 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:31.846753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4135bb-a84a-438b-b339-2f2af9f3fd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:31.847440 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4135bb-a84a-438b-b339-2f2af9f3fd3f admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:31.847716 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4135bb-a84a-438b-b339-2f2af9f3fd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:31.847982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4135bb-a84a-438b-b339-2f2af9f3fd3f admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:31.848671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4135bb-a84a-438b-b339-2f2af9f3fd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:31.850558 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4135bb-a84a-438b-b339-2f2af9f3fd3f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:31.869560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1148/2282] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:40:31 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:40:31.873634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69a04b-2d6b-4abd-a6b7-27af656223a8 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:31.883802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69a04b-2d6b-4abd-a6b7-27af656223a8 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:31.888299 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc72c0b-8157-4068-b89b-3bab12b54ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:31.889454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72c0b-8157-4068-b89b-3bab12b54ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:31.889726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72c0b-8157-4068-b89b-3bab12b54ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:31.889989 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72c0b-8157-4068-b89b-3bab12b54ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:31.890699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc72c0b-8157-4068-b89b-3bab12b54ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:31.892335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc72c0b-8157-4068-b89b-3bab12b54ba4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:31.902210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1135/2283] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:40:31.906488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4135bb-a84a-438b-b339-2f2af9f3fd3f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:31.916309 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4135bb-a84a-438b-b339-2f2af9f3fd3f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:31.921510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12767ed8-cb4a-4f31-8532-a81bffa301aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:31.922241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12767ed8-cb4a-4f31-8532-a81bffa301aa admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:31.922522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12767ed8-cb4a-4f31-8532-a81bffa301aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:31.922891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12767ed8-cb4a-4f31-8532-a81bffa301aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:31.923729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12767ed8-cb4a-4f31-8532-a81bffa301aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:31.925571 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12767ed8-cb4a-4f31-8532-a81bffa301aa admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:31.935856 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1149/2284] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:40:31.940104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc72c0b-8157-4068-b89b-3bab12b54ba4 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:31.949796 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc72c0b-8157-4068-b89b-3bab12b54ba4 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:31.954842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a82fd8-73ee-4962-8ffd-5de24a44bf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:31.955719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a82fd8-73ee-4962-8ffd-5de24a44bf08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:31.955993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a82fd8-73ee-4962-8ffd-5de24a44bf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:31.956262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a82fd8-73ee-4962-8ffd-5de24a44bf08 admin admin] PATH_INFO: `/v3/projects/d4f41fea31a14b6e8315884b4cdf4748/users/072e0abc3fe64a5ab0c8d7233f8fe66c/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:31.971548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a82fd8-73ee-4962-8ffd-5de24a44bf08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f41fea31a14b6e8315884b4cdf4748, user_id=072e0abc3fe64a5ab0c8d7233f8fe66c, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:31.974145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a82fd8-73ee-4962-8ffd-5de24a44bf08 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:31.986324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1136/2285] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:40:31 2022] PUT /identity/v3/projects/d4f41fea31a14b6e8315884b4cdf4748/users/072e0abc3fe64a5ab0c8d7233f8fe66c/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:40:31.996345 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc98c5-b878-4f0b-a970-7b94818d0699 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:31.996692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc98c5-b878-4f0b-a970-7b94818d0699 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:31.996972 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc98c5-b878-4f0b-a970-7b94818d0699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:32.023229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-01bc98c5-b878-4f0b-a970-7b94818d0699 None None] MFA Rules not processed for user `072e0abc3fe64a5ab0c8d7233f8fe66c`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:32.024420 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-01bc98c5-b878-4f0b-a970-7b94818d0699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:32.089919 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1150/2286] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:33.306742 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a82fd8-73ee-4962-8ffd-5de24a44bf08 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:33.308824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-71a82fd8-73ee-4962-8ffd-5de24a44bf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:33.366170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a82fd8-73ee-4962-8ffd-5de24a44bf08 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:33.370666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea73c37-2157-4644-bbca-556ebe917cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:33.371332 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea73c37-2157-4644-bbca-556ebe917cda service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:33.371608 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea73c37-2157-4644-bbca-556ebe917cda service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:33.371874 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea73c37-2157-4644-bbca-556ebe917cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:33.380211 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea73c37-2157-4644-bbca-556ebe917cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:33.381889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea73c37-2157-4644-bbca-556ebe917cda service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:33.391752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1137/2287] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:40:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:40:56.284783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc287-28a6-4295-b163-a70b3ff62132 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:56.285268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc287-28a6-4295-b163-a70b3ff62132 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:56.285371 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc287-28a6-4295-b163-a70b3ff62132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:56.318698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-a8ffc287-28a6-4295-b163-a70b3ff62132 None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:56.319939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a8ffc287-28a6-4295-b163-a70b3ff62132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:56.391671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1151/2288] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:40:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:56.455318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea73c37-2157-4644-bbca-556ebe917cda service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:56.456836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-1ea73c37-2157-4644-bbca-556ebe917cda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:56.556215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea73c37-2157-4644-bbca-556ebe917cda service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:56.570201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597955e0-caa6-4ffb-8270-aacebb721e78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:56.571080 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597955e0-caa6-4ffb-8270-aacebb721e78 service swift] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:56.571622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597955e0-caa6-4ffb-8270-aacebb721e78 service swift] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:56.571973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597955e0-caa6-4ffb-8270-aacebb721e78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:56.583210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597955e0-caa6-4ffb-8270-aacebb721e78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:56.585039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597955e0-caa6-4ffb-8270-aacebb721e78 service swift] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:56.596003 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1138/2289] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:40:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:40:56.902378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1746-9e8d-4f56-88d0-8c1235ecb6de None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:56.902734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1746-9e8d-4f56-88d0-8c1235ecb6de None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:56.902959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1746-9e8d-4f56-88d0-8c1235ecb6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:56.923627 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-539a1746-9e8d-4f56-88d0-8c1235ecb6de None None] MFA Rules not processed for user `b17dd7414b474fcfb8406d11fef7e95d`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:56.925049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-539a1746-9e8d-4f56-88d0-8c1235ecb6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:56.982398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1152/2290] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:40:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:00.988371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597955e0-caa6-4ffb-8270-aacebb721e78 service swift] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:00.990947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-597955e0-caa6-4ffb-8270-aacebb721e78 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:01.102211 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597955e0-caa6-4ffb-8270-aacebb721e78 service swift] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:01.111589 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:01.112780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:01.113222 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:01.113660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] PATH_INFO: `/v3/users/d6c47ee411fd43849fe6475daaa431fd` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:01.115114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c47ee411fd43849fe6475daaa431fd)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:01.117373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:01.183907 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c47ee411fd43849fe6475daaa431fd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:01.184623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c47ee411fd43849fe6475daaa431fd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:01.206243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c47ee411fd43849fe6475daaa431fd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:01.215895 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c47ee411fd43849fe6475daaa431fd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:01.223748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c47ee411fd43849fe6475daaa431fd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:01.230070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1139/2291] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:41:00 2022] DELETE /identity/v3/users/d6c47ee411fd43849fe6475daaa431fd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:01.234552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a42a-8436-49c1-984c-0767e5eaa788 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:01.235134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a42a-8436-49c1-984c-0767e5eaa788 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:01.235134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a42a-8436-49c1-984c-0767e5eaa788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:01.252321 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-3413a42a-8436-49c1-984c-0767e5eaa788 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:01.253494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3413a42a-8436-49c1-984c-0767e5eaa788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:01.328619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1153/2292] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:01.339457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:01.340979 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:01.412904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed95ba-6364-457c-98c3-b8e64c358d2f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:01.419812 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d43e3b-d15b-41a6-86e9-315b56790c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:01.421073 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d43e3b-d15b-41a6-86e9-315b56790c85 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:01.421564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d43e3b-d15b-41a6-86e9-315b56790c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:01.422060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d43e3b-d15b-41a6-86e9-315b56790c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:01.433597 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d43e3b-d15b-41a6-86e9-315b56790c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:01.435266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d43e3b-d15b-41a6-86e9-315b56790c85 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:01.445684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1140/2293] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:01.886433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413a42a-8436-49c1-984c-0767e5eaa788 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:01.888928 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3413a42a-8436-49c1-984c-0767e5eaa788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:01.906459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413a42a-8436-49c1-984c-0767e5eaa788 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:01.918836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cf63e-4e97-4241-adcd-cd8fc1ab1276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:01.920600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf63e-4e97-4241-adcd-cd8fc1ab1276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:01.921021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf63e-4e97-4241-adcd-cd8fc1ab1276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:01.921503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf63e-4e97-4241-adcd-cd8fc1ab1276 admin admin] PATH_INFO: `/v3/users/072e0abc3fe64a5ab0c8d7233f8fe66c` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:01.922940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cf63e-4e97-4241-adcd-cd8fc1ab1276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072e0abc3fe64a5ab0c8d7233f8fe66c)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:01.925781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cf63e-4e97-4241-adcd-cd8fc1ab1276 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:01.991500 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d43e3b-d15b-41a6-86e9-315b56790c85 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:01.993832 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d7d43e3b-d15b-41a6-86e9-315b56790c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:01.998267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-082cf63e-4e97-4241-adcd-cd8fc1ab1276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072e0abc3fe64a5ab0c8d7233f8fe66c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:01.999144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-082cf63e-4e97-4241-adcd-cd8fc1ab1276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072e0abc3fe64a5ab0c8d7233f8fe66c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:02.000063 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-082cf63e-4e97-4241-adcd-cd8fc1ab1276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072e0abc3fe64a5ab0c8d7233f8fe66c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:02.015174 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d43e3b-d15b-41a6-86e9-315b56790c85 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:02.019070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-082cf63e-4e97-4241-adcd-cd8fc1ab1276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072e0abc3fe64a5ab0c8d7233f8fe66c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:02.021231 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:02.022382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.022887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.023631 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] PATH_INFO: `/v3/projects/26433fef4ff04344adb7ef1bd9e66e42` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:02.025720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=26433fef4ff04344adb7ef1bd9e66e42)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:02.028675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:02.030889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-082cf63e-4e97-4241-adcd-cd8fc1ab1276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072e0abc3fe64a5ab0c8d7233f8fe66c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:02.048892 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1154/2294] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:41:01 2022] DELETE /identity/v3/users/072e0abc3fe64a5ab0c8d7233f8fe66c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:02.051167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee595dec-b726-40e6-ba08-fb43981ea2eb None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.061448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee595dec-b726-40e6-ba08-fb43981ea2eb None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.061448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee595dec-b726-40e6-ba08-fb43981ea2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:02.077704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-ee595dec-b726-40e6-ba08-fb43981ea2eb None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:02.088423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ee595dec-b726-40e6-ba08-fb43981ea2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:02.128944 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26433fef4ff04344adb7ef1bd9e66e42', 'request_id': 'req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:02.143453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26433fef4ff04344adb7ef1bd9e66e42', 'request_id': 'req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:02.156937 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26433fef4ff04344adb7ef1bd9e66e42', 'request_id': 'req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:02.206528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] The token cache is being invalidate because project 26433fef4ff04344adb7ef1bd9e66e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:41:02.206795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:02.209634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b791cbdd-7c75-4fae-bd62-6c73fc85c5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:02.212949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1141/2295] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:41:01 2022] DELETE /identity/v3/projects/26433fef4ff04344adb7ef1bd9e66e42 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:02.230471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c91427-0fff-48a5-b14d-c719105eb902 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.230964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c91427-0fff-48a5-b14d-c719105eb902 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.231408 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c91427-0fff-48a5-b14d-c719105eb902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:02.287620 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-30c91427-0fff-48a5-b14d-c719105eb902 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:02.288826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-30c91427-0fff-48a5-b14d-c719105eb902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:02.317959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1155/2296] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:02.338359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee595dec-b726-40e6-ba08-fb43981ea2eb None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:02.339819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ee595dec-b726-40e6-ba08-fb43981ea2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:02.382370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1142/2297] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:02.392293 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012cb59-e557-43a9-b2de-87cae7e4ee87 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.392787 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012cb59-e557-43a9-b2de-87cae7e4ee87 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.393191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012cb59-e557-43a9-b2de-87cae7e4ee87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:02.457284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0012cb59-e557-43a9-b2de-87cae7e4ee87 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:02.460214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0012cb59-e557-43a9-b2de-87cae7e4ee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:02.482533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee595dec-b726-40e6-ba08-fb43981ea2eb None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:02.482694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1143/2298] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:02.485412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012cb59-e557-43a9-b2de-87cae7e4ee87 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:02.502848 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012cb59-e557-43a9-b2de-87cae7e4ee87 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:02.514692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6c3a0-c4d4-489e-bec0-a6e0f1f2e9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:02.515531 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6c3a0-c4d4-489e-bec0-a6e0f1f2e9de admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.515809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6c3a0-c4d4-489e-bec0-a6e0f1f2e9de admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.516080 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6c3a0-c4d4-489e-bec0-a6e0f1f2e9de admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:02.516807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6c3a0-c4d4-489e-bec0-a6e0f1f2e9de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:41:02.517108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6c3a0-c4d4-489e-bec0-a6e0f1f2e9de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:02.522130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6c3a0-c4d4-489e-bec0-a6e0f1f2e9de admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:02.538480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826021c7-f46d-4053-86ab-839d0d666236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:02.539061 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826021c7-f46d-4053-86ab-839d0d666236 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.539594 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826021c7-f46d-4053-86ab-839d0d666236 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.539971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826021c7-f46d-4053-86ab-839d0d666236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:02.550555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826021c7-f46d-4053-86ab-839d0d666236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:02.552282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826021c7-f46d-4053-86ab-839d0d666236 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:02.565489 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1144/2299] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:41:02.566276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1156/2300] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:02.566566 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6c3a0-c4d4-489e-bec0-a6e0f1f2e9de admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:02.579241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6c3a0-c4d4-489e-bec0-a6e0f1f2e9de admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:02.584178 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c91455-d94d-4a30-be81-c66502b423c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:02.584836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c91455-d94d-4a30-be81-c66502b423c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.586094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c91455-d94d-4a30-be81-c66502b423c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.586461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c91455-d94d-4a30-be81-c66502b423c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:02.587198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c91455-d94d-4a30-be81-c66502b423c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:02.589274 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c91455-d94d-4a30-be81-c66502b423c9 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:02.637520 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1145/2301] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:41:02 2022] POST /identity/v3/projects => generated 389 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:02.645184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826021c7-f46d-4053-86ab-839d0d666236 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:02.658085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826021c7-f46d-4053-86ab-839d0d666236 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:02.765490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f3439-3211-4817-9fd8-f7b4df0f0517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:02.766382 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3439-3211-4817-9fd8-f7b4df0f0517 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.766720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3439-3211-4817-9fd8-f7b4df0f0517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.767024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3439-3211-4817-9fd8-f7b4df0f0517 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:02.767821 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f3439-3211-4817-9fd8-f7b4df0f0517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:02.770648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f3439-3211-4817-9fd8-f7b4df0f0517 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:02.796362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1157/2302] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:41:02 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:02.800401 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c91455-d94d-4a30-be81-c66502b423c9 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:02.815053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c91455-d94d-4a30-be81-c66502b423c9 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:02.823234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7cec7-2e1f-450f-96d8-ec7629417391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:02.823981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7cec7-2e1f-450f-96d8-ec7629417391 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.824366 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7cec7-2e1f-450f-96d8-ec7629417391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.824924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7cec7-2e1f-450f-96d8-ec7629417391 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:02.826367 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7cec7-2e1f-450f-96d8-ec7629417391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:02.828129 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7cec7-2e1f-450f-96d8-ec7629417391 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:02.842231 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1146/2303] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:41:02.844365 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f3439-3211-4817-9fd8-f7b4df0f0517 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:02.863019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f3439-3211-4817-9fd8-f7b4df0f0517 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:02.869188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e775a99-cd30-427c-830d-ad91f64a2327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:02.869952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e775a99-cd30-427c-830d-ad91f64a2327 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.870376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e775a99-cd30-427c-830d-ad91f64a2327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.870820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e775a99-cd30-427c-830d-ad91f64a2327 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:02.871630 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e775a99-cd30-427c-830d-ad91f64a2327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:02.873501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e775a99-cd30-427c-830d-ad91f64a2327 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:02.885803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1158/2304] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:02.890448 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7cec7-2e1f-450f-96d8-ec7629417391 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:02.901599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7cec7-2e1f-450f-96d8-ec7629417391 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:02.907266 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb082dc8-2b90-4e29-a66d-df87d7427dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:02.908376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb082dc8-2b90-4e29-a66d-df87d7427dca admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.908841 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb082dc8-2b90-4e29-a66d-df87d7427dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.909215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb082dc8-2b90-4e29-a66d-df87d7427dca admin admin] PATH_INFO: `/v3/projects/cf63b36d323a4daa837292f52f9f9d4f/users/11447ff6f83a4a7a96d9549f3172764e/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:02.927829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb082dc8-2b90-4e29-a66d-df87d7427dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf63b36d323a4daa837292f52f9f9d4f, user_id=11447ff6f83a4a7a96d9549f3172764e, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:02.932110 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb082dc8-2b90-4e29-a66d-df87d7427dca admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:02.953593 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1147/2305] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:41:02 2022] PUT /identity/v3/projects/cf63b36d323a4daa837292f52f9f9d4f/users/11447ff6f83a4a7a96d9549f3172764e/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:02.963381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad2619-b2c6-4bf4-94bf-7c583d7831e9 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:02.963751 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad2619-b2c6-4bf4-94bf-7c583d7831e9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:02.964093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad2619-b2c6-4bf4-94bf-7c583d7831e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:03.003148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-cbad2619-b2c6-4bf4-94bf-7c583d7831e9 None None] MFA Rules not processed for user `11447ff6f83a4a7a96d9549f3172764e`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:03.004468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cbad2619-b2c6-4bf4-94bf-7c583d7831e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:03.131671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1159/2306] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:03.148020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb082dc8-2b90-4e29-a66d-df87d7427dca admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:03.152378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-cb082dc8-2b90-4e29-a66d-df87d7427dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:03.306214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb082dc8-2b90-4e29-a66d-df87d7427dca admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:03.311295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eedfca-1d20-4a5f-add1-7b04fb6e8f49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:03.312366 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eedfca-1d20-4a5f-add1-7b04fb6e8f49 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:03.312799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eedfca-1d20-4a5f-add1-7b04fb6e8f49 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:03.313171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eedfca-1d20-4a5f-add1-7b04fb6e8f49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:03.323539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad2619-b2c6-4bf4-94bf-7c583d7831e9 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:03.325318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cbad2619-b2c6-4bf4-94bf-7c583d7831e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:03.327088 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eedfca-1d20-4a5f-add1-7b04fb6e8f49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:03.328778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eedfca-1d20-4a5f-add1-7b04fb6e8f49 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:03.343888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1148/2307] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:03.457457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad2619-b2c6-4bf4-94bf-7c583d7831e9 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:03.463258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:03.464101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:03.464379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:03.464651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] PATH_INFO: `/v3/projects/d4f41fea31a14b6e8315884b4cdf4748` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:03.465940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f41fea31a14b6e8315884b4cdf4748)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:03.467932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:03.537810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f41fea31a14b6e8315884b4cdf4748', 'request_id': 'req-24ab15e4-7d4b-410f-a104-2a69e07cce14'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:03.549415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f41fea31a14b6e8315884b4cdf4748', 'request_id': 'req-24ab15e4-7d4b-410f-a104-2a69e07cce14'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:03.574353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f41fea31a14b6e8315884b4cdf4748', 'request_id': 'req-24ab15e4-7d4b-410f-a104-2a69e07cce14'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:03.594222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] The token cache is being invalidate because project d4f41fea31a14b6e8315884b4cdf4748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:41:03.594540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:03.596369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-24ab15e4-7d4b-410f-a104-2a69e07cce14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:03.599085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1160/2308] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:41:03 2022] DELETE /identity/v3/projects/d4f41fea31a14b6e8315884b4cdf4748 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:41:03.604902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dce29-bd1a-4bc0-bcfb-f991ae3f76ac None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:03.605201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dce29-bd1a-4bc0-bcfb-f991ae3f76ac None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:03.605815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dce29-bd1a-4bc0-bcfb-f991ae3f76ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:03.629645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a13dce29-bd1a-4bc0-bcfb-f991ae3f76ac None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:03.630977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a13dce29-bd1a-4bc0-bcfb-f991ae3f76ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:03.801926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1149/2309] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:03.812016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947126b-0c8a-494f-b891-16e1369b766e None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:03.812376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947126b-0c8a-494f-b891-16e1369b766e None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:03.812699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947126b-0c8a-494f-b891-16e1369b766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:03.848621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2947126b-0c8a-494f-b891-16e1369b766e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:03.850082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2947126b-0c8a-494f-b891-16e1369b766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:03.861062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1161/2310] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:03.865566 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dce29-bd1a-4bc0-bcfb-f991ae3f76ac None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:03.877925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dce29-bd1a-4bc0-bcfb-f991ae3f76ac None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:03.889511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2124f58-8d42-47b3-8be9-d6387096952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:03.890501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2124f58-8d42-47b3-8be9-d6387096952f admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:03.890787 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2124f58-8d42-47b3-8be9-d6387096952f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:03.891181 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2124f58-8d42-47b3-8be9-d6387096952f admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:03.891997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2124f58-8d42-47b3-8be9-d6387096952f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:41:03.892315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2124f58-8d42-47b3-8be9-d6387096952f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:03.893987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2124f58-8d42-47b3-8be9-d6387096952f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:03.912064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947126b-0c8a-494f-b891-16e1369b766e None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:03.913905 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2947126b-0c8a-494f-b891-16e1369b766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:03.917526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1150/2311] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:41:03.918502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2124f58-8d42-47b3-8be9-d6387096952f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:03.933537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947126b-0c8a-494f-b891-16e1369b766e None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:03.939451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2124f58-8d42-47b3-8be9-d6387096952f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:03.941026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddcbeb-2a68-4feb-b79b-b1aac899051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:03.941917 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddcbeb-2a68-4feb-b79b-b1aac899051f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:03.942191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddcbeb-2a68-4feb-b79b-b1aac899051f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:03.942460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddcbeb-2a68-4feb-b79b-b1aac899051f admin admin] PATH_INFO: `/v3/users/bd6237f9dc0f44a293bd1346dc182325` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:03.944614 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543e0da-d619-47ff-b69f-b530abc7737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:03.945344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543e0da-d619-47ff-b69f-b530abc7737a admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:03.945711 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543e0da-d619-47ff-b69f-b530abc7737a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:03.946053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543e0da-d619-47ff-b69f-b530abc7737a admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:03.946377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddcbeb-2a68-4feb-b79b-b1aac899051f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd6237f9dc0f44a293bd1346dc182325)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:03.946875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543e0da-d619-47ff-b69f-b530abc7737a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:03.948339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddcbeb-2a68-4feb-b79b-b1aac899051f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:03.949060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543e0da-d619-47ff-b69f-b530abc7737a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:03.988600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1151/2312] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:41:03 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:03.993048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543e0da-d619-47ff-b69f-b530abc7737a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:04.013808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8cddcbeb-2a68-4feb-b79b-b1aac899051f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd6237f9dc0f44a293bd1346dc182325'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:04.015054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8cddcbeb-2a68-4feb-b79b-b1aac899051f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd6237f9dc0f44a293bd1346dc182325'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:04.015768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8cddcbeb-2a68-4feb-b79b-b1aac899051f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd6237f9dc0f44a293bd1346dc182325'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:04.028383 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8cddcbeb-2a68-4feb-b79b-b1aac899051f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd6237f9dc0f44a293bd1346dc182325'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:04.039537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8cddcbeb-2a68-4feb-b79b-b1aac899051f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd6237f9dc0f44a293bd1346dc182325'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:04.062125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1162/2313] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:41:03 2022] DELETE /identity/v3/users/bd6237f9dc0f44a293bd1346dc182325 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:04.063829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57556784-5e63-4e42-bd7e-df20e77d0b86 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:04.064114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57556784-5e63-4e42-bd7e-df20e77d0b86 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:04.064490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57556784-5e63-4e42-bd7e-df20e77d0b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:04.088138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543e0da-d619-47ff-b69f-b530abc7737a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:04.101253 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-57556784-5e63-4e42-bd7e-df20e77d0b86 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:04.103005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-57556784-5e63-4e42-bd7e-df20e77d0b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:04.157052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c166f7-e771-40b1-b98f-8053916484a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:04.157732 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c166f7-e771-40b1-b98f-8053916484a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:04.158009 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c166f7-e771-40b1-b98f-8053916484a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:04.158452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c166f7-e771-40b1-b98f-8053916484a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:04.159198 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c166f7-e771-40b1-b98f-8053916484a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:04.161239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c166f7-e771-40b1-b98f-8053916484a9 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:04.198103 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1152/2314] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:41:03 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:04.199281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c166f7-e771-40b1-b98f-8053916484a9 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:04.202338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b7c166f7-e771-40b1-b98f-8053916484a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:04.215474 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c166f7-e771-40b1-b98f-8053916484a9 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:04.228601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1163/2315] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:41:04.234433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6d727-cb03-44ba-bbfa-08c1be8833ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:04.235309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6d727-cb03-44ba-bbfa-08c1be8833ed admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:04.235702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6d727-cb03-44ba-bbfa-08c1be8833ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:04.236212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6d727-cb03-44ba-bbfa-08c1be8833ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:04.236798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6d727-cb03-44ba-bbfa-08c1be8833ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:04.238547 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6d727-cb03-44ba-bbfa-08c1be8833ed admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:04.244194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57556784-5e63-4e42-bd7e-df20e77d0b86 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:04.245725 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-57556784-5e63-4e42-bd7e-df20e77d0b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:04.259016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1153/2316] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:04.259016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6d727-cb03-44ba-bbfa-08c1be8833ed admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:04.299427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6d727-cb03-44ba-bbfa-08c1be8833ed admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:04.312208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a94b56-a5e1-49d7-b92f-d33f371e2f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:04.312813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94b56-a5e1-49d7-b92f-d33f371e2f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:04.313097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94b56-a5e1-49d7-b92f-d33f371e2f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:04.313368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94b56-a5e1-49d7-b92f-d33f371e2f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:04.314086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a94b56-a5e1-49d7-b92f-d33f371e2f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:04.315708 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a94b56-a5e1-49d7-b92f-d33f371e2f8f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:04.331098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1154/2317] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:04.339635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a94b56-a5e1-49d7-b92f-d33f371e2f8f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:04.344715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57556784-5e63-4e42-bd7e-df20e77d0b86 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:04.351026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bb4ec-0a2e-4a45-b8ef-ed5d5925ac4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:04.351869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bb4ec-0a2e-4a45-b8ef-ed5d5925ac4d service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:04.352598 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bb4ec-0a2e-4a45-b8ef-ed5d5925ac4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:04.352812 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a94b56-a5e1-49d7-b92f-d33f371e2f8f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:04.353296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bb4ec-0a2e-4a45-b8ef-ed5d5925ac4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:04.363894 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1aac8-0d5a-483a-9213-e3aa2ad60ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:04.365145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1aac8-0d5a-483a-9213-e3aa2ad60ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:04.365281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bb4ec-0a2e-4a45-b8ef-ed5d5925ac4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:04.366962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bb4ec-0a2e-4a45-b8ef-ed5d5925ac4d service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:04.367118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1aac8-0d5a-483a-9213-e3aa2ad60ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:04.367541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1aac8-0d5a-483a-9213-e3aa2ad60ae4 admin admin] PATH_INFO: `/v3/projects/d49baa9a7922438f99d7dcc9ef7c1c15/users/9e3ca0cfe4ad49bd90027a7ea95bf024/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:04.381924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1164/2318] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:41:04.408588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1aac8-0d5a-483a-9213-e3aa2ad60ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49baa9a7922438f99d7dcc9ef7c1c15, user_id=9e3ca0cfe4ad49bd90027a7ea95bf024, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:04.412681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1aac8-0d5a-483a-9213-e3aa2ad60ae4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:04.441515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1155/2319] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:41:04 2022] PUT /identity/v3/projects/d49baa9a7922438f99d7dcc9ef7c1c15/users/9e3ca0cfe4ad49bd90027a7ea95bf024/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:41:04.443274 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7b40e-827d-4c84-b95b-9ed14d476d61 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:04.443566 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7b40e-827d-4c84-b95b-9ed14d476d61 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:04.443844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7b40e-827d-4c84-b95b-9ed14d476d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:04.468062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-edf7b40e-827d-4c84-b95b-9ed14d476d61 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:04.469381 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-edf7b40e-827d-4c84-b95b-9ed14d476d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:04.573609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1165/2320] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:04.583626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1aac8-0d5a-483a-9213-e3aa2ad60ae4 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:04.587945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-cbf1aac8-0d5a-483a-9213-e3aa2ad60ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:04.692146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1aac8-0d5a-483a-9213-e3aa2ad60ae4 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:04.696480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d47fe7-dca3-4c71-985c-861d8575f0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:04.697144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47fe7-dca3-4c71-985c-861d8575f0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:04.697562 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47fe7-dca3-4c71-985c-861d8575f0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:04.697891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47fe7-dca3-4c71-985c-861d8575f0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:04.710674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d47fe7-dca3-4c71-985c-861d8575f0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:04.718475 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d47fe7-dca3-4c71-985c-861d8575f0e1 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:04.733942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1156/2321] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:04.836110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7b40e-827d-4c84-b95b-9ed14d476d61 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:04.837719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-edf7b40e-827d-4c84-b95b-9ed14d476d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:04.869503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7b40e-827d-4c84-b95b-9ed14d476d61 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:04.879932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:04.880805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:04.881352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:04.881786 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] PATH_INFO: `/v3/projects/d2893b07a4564b0885439092f15bfdfb` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:04.885280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2893b07a4564b0885439092f15bfdfb)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:04.887249 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:05.003407 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2893b07a4564b0885439092f15bfdfb', 'request_id': 'req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:05.012757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2893b07a4564b0885439092f15bfdfb', 'request_id': 'req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:05.025120 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2893b07a4564b0885439092f15bfdfb', 'request_id': 'req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:05.074108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] The token cache is being invalidate because project d2893b07a4564b0885439092f15bfdfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:41:05.074535 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:05.075397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-20f617a3-4b3a-4683-a5bc-ab88adf6a12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:05.081650 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1166/2322] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:41:04 2022] DELETE /identity/v3/projects/d2893b07a4564b0885439092f15bfdfb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:05.084170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905451e-f642-4c7e-b2d5-b75ede97a5f4 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:05.084741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905451e-f642-4c7e-b2d5-b75ede97a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:05.085496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905451e-f642-4c7e-b2d5-b75ede97a5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:05.112664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-f905451e-f642-4c7e-b2d5-b75ede97a5f4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:05.127055 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f905451e-f642-4c7e-b2d5-b75ede97a5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:05.258010 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1157/2323] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:05.268658 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a3f89-1365-4bcd-81eb-d5d2310e574d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:05.268956 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a3f89-1365-4bcd-81eb-d5d2310e574d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:05.269212 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a3f89-1365-4bcd-81eb-d5d2310e574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:05.300735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-284a3f89-1365-4bcd-81eb-d5d2310e574d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:05.302551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-284a3f89-1365-4bcd-81eb-d5d2310e574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:05.331267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1167/2324] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:05.333946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905451e-f642-4c7e-b2d5-b75ede97a5f4 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:05.348388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905451e-f642-4c7e-b2d5-b75ede97a5f4 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:05.354253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35188f7-dbce-481d-a388-14495c1575da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:05.355124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35188f7-dbce-481d-a388-14495c1575da admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:05.355403 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35188f7-dbce-481d-a388-14495c1575da admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:05.355675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35188f7-dbce-481d-a388-14495c1575da admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:05.356472 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35188f7-dbce-481d-a388-14495c1575da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:41:05.356826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35188f7-dbce-481d-a388-14495c1575da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:05.359184 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35188f7-dbce-481d-a388-14495c1575da admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:05.379122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1158/2325] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:41:05.380220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a3f89-1365-4bcd-81eb-d5d2310e574d None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:05.415687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a3f89-1365-4bcd-81eb-d5d2310e574d None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:05.441118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a179ee5-1a43-4b57-b419-a9764618d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:05.443162 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a179ee5-1a43-4b57-b419-a9764618d317 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:05.443449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a179ee5-1a43-4b57-b419-a9764618d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:05.443729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a179ee5-1a43-4b57-b419-a9764618d317 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:05.447402 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a179ee5-1a43-4b57-b419-a9764618d317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:05.465420 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a179ee5-1a43-4b57-b419-a9764618d317 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:05.510261 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1168/2326] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:41:05 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:41:05.515674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35188f7-dbce-481d-a388-14495c1575da admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:05.535758 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35188f7-dbce-481d-a388-14495c1575da admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:05.633078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab195f-5b8d-4974-95dd-fd0cad52ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:05.634289 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab195f-5b8d-4974-95dd-fd0cad52ee2a admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:05.634675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab195f-5b8d-4974-95dd-fd0cad52ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:05.635085 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab195f-5b8d-4974-95dd-fd0cad52ee2a admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:05.636285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab195f-5b8d-4974-95dd-fd0cad52ee2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:05.638360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab195f-5b8d-4974-95dd-fd0cad52ee2a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:05.689294 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1159/2327] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:41:05 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:41:05.690820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a179ee5-1a43-4b57-b419-a9764618d317 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:05.705524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a179ee5-1a43-4b57-b419-a9764618d317 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:05.714744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26507c15-d77e-4d83-b69c-8d5f3208a649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:05.715620 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507c15-d77e-4d83-b69c-8d5f3208a649 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:05.715973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507c15-d77e-4d83-b69c-8d5f3208a649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:05.716304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507c15-d77e-4d83-b69c-8d5f3208a649 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:05.717218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26507c15-d77e-4d83-b69c-8d5f3208a649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:05.719050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26507c15-d77e-4d83-b69c-8d5f3208a649 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:05.737128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1169/2328] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:05.739701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab195f-5b8d-4974-95dd-fd0cad52ee2a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:05.761045 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab195f-5b8d-4974-95dd-fd0cad52ee2a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:05.768769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c02b0c-849c-4612-93db-67eecdb42afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:05.770396 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02b0c-849c-4612-93db-67eecdb42afd admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:05.770550 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02b0c-849c-4612-93db-67eecdb42afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:05.770718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02b0c-849c-4612-93db-67eecdb42afd admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:05.771482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c02b0c-849c-4612-93db-67eecdb42afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:05.773624 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c02b0c-849c-4612-93db-67eecdb42afd admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:05.789481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1160/2329] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:05.790701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26507c15-d77e-4d83-b69c-8d5f3208a649 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:05.812342 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26507c15-d77e-4d83-b69c-8d5f3208a649 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:05.817843 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328ec8f-5e7b-4469-9414-bf3d9365cb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:05.818779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328ec8f-5e7b-4469-9414-bf3d9365cb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:05.819094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328ec8f-5e7b-4469-9414-bf3d9365cb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:05.819367 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328ec8f-5e7b-4469-9414-bf3d9365cb15 admin admin] PATH_INFO: `/v3/projects/3a11b92e88664251b219068ea7a06b2a/users/12bfd90e4c464ff68264867a11624098/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:05.845778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328ec8f-5e7b-4469-9414-bf3d9365cb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a11b92e88664251b219068ea7a06b2a, user_id=12bfd90e4c464ff68264867a11624098, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:05.852912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328ec8f-5e7b-4469-9414-bf3d9365cb15 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:05.877213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1170/2330] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:41:05 2022] PUT /identity/v3/projects/3a11b92e88664251b219068ea7a06b2a/users/12bfd90e4c464ff68264867a11624098/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:41:05.887755 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9e079-7834-4d2a-9148-0f9527bce602 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:05.888260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9e079-7834-4d2a-9148-0f9527bce602 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:05.888659 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9e079-7834-4d2a-9148-0f9527bce602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:05.929928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c6c9e079-7834-4d2a-9148-0f9527bce602 None None] MFA Rules not processed for user `12bfd90e4c464ff68264867a11624098`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:05.931298 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c6c9e079-7834-4d2a-9148-0f9527bce602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:06.080971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1161/2331] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:06.094191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328ec8f-5e7b-4469-9414-bf3d9365cb15 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:06.196772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328ec8f-5e7b-4469-9414-bf3d9365cb15 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:06.208450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e41a8-004c-4db2-9622-8e8f407c5a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:06.241392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e41a8-004c-4db2-9622-8e8f407c5a8e admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:06.241392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e41a8-004c-4db2-9622-8e8f407c5a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:06.241654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e41a8-004c-4db2-9622-8e8f407c5a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:06.243525 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e41a8-004c-4db2-9622-8e8f407c5a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:06.250246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e41a8-004c-4db2-9622-8e8f407c5a8e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:06.338156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1171/2332] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:41:06 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:06.340392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9e079-7834-4d2a-9148-0f9527bce602 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:06.374016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9e079-7834-4d2a-9148-0f9527bce602 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:06.483333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4e668-28e2-4042-bec0-ff31dcee34b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:06.484304 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4e668-28e2-4042-bec0-ff31dcee34b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:06.484584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4e668-28e2-4042-bec0-ff31dcee34b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:06.484856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4e668-28e2-4042-bec0-ff31dcee34b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:06.485705 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4e668-28e2-4042-bec0-ff31dcee34b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:06.487846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4e668-28e2-4042-bec0-ff31dcee34b3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:06.520501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1162/2333] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:41:06 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:06.524311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e41a8-004c-4db2-9622-8e8f407c5a8e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:06.547400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e41a8-004c-4db2-9622-8e8f407c5a8e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:06.568944 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ccc77-bf4c-41b0-8c93-d38c7960e691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:06.569626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ccc77-bf4c-41b0-8c93-d38c7960e691 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:06.569914 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ccc77-bf4c-41b0-8c93-d38c7960e691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:06.570186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ccc77-bf4c-41b0-8c93-d38c7960e691 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:06.570947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ccc77-bf4c-41b0-8c93-d38c7960e691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:06.572702 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ccc77-bf4c-41b0-8c93-d38c7960e691 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:06.611174 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1172/2334] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:41:06.611270 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4e668-28e2-4042-bec0-ff31dcee34b3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:06.631729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4e668-28e2-4042-bec0-ff31dcee34b3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:06.641020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537cef-b568-483f-a518-a8b986b17d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:06.641721 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537cef-b568-483f-a518-a8b986b17d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:06.642002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537cef-b568-483f-a518-a8b986b17d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:06.642275 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537cef-b568-483f-a518-a8b986b17d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:06.643161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6537cef-b568-483f-a518-a8b986b17d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:06.644723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6537cef-b568-483f-a518-a8b986b17d23 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:06.656000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1163/2335] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:41:06.659778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ccc77-bf4c-41b0-8c93-d38c7960e691 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:06.679323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ccc77-bf4c-41b0-8c93-d38c7960e691 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:06.695664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d965c-9be6-407d-ad56-aa92a27d1eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:06.696926 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d965c-9be6-407d-ad56-aa92a27d1eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:06.697210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d965c-9be6-407d-ad56-aa92a27d1eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:06.697482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d965c-9be6-407d-ad56-aa92a27d1eb7 admin admin] PATH_INFO: `/v3/projects/7449871cabbd4638a5844671816a4327/users/73f64223586e49c098a0ef0470518a24/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:06.729958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d965c-9be6-407d-ad56-aa92a27d1eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7449871cabbd4638a5844671816a4327, user_id=73f64223586e49c098a0ef0470518a24, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:06.737911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d965c-9be6-407d-ad56-aa92a27d1eb7 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:06.768672 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1173/2336] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:41:06 2022] PUT /identity/v3/projects/7449871cabbd4638a5844671816a4327/users/73f64223586e49c098a0ef0470518a24/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:06.780134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cde90-b4c5-4e1d-9195-d3aaa5ec8397 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:06.780515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cde90-b4c5-4e1d-9195-d3aaa5ec8397 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:06.780865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cde90-b4c5-4e1d-9195-d3aaa5ec8397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:06.823475 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c28cde90-b4c5-4e1d-9195-d3aaa5ec8397 None None] MFA Rules not processed for user `73f64223586e49c098a0ef0470518a24`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:06.824833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c28cde90-b4c5-4e1d-9195-d3aaa5ec8397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:06.952493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1164/2337] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:06.956407 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d965c-9be6-407d-ad56-aa92a27d1eb7 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:07.053456 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d965c-9be6-407d-ad56-aa92a27d1eb7 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:07.063497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f0ef6-5761-41a8-b748-235eb0472a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:07.065663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f0ef6-5761-41a8-b748-235eb0472a61 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:07.066717 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f0ef6-5761-41a8-b748-235eb0472a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:07.067327 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f0ef6-5761-41a8-b748-235eb0472a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:07.068482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f0ef6-5761-41a8-b748-235eb0472a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:07.072762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f0ef6-5761-41a8-b748-235eb0472a61 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:07.118484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1174/2338] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:41:06 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:07.123048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cde90-b4c5-4e1d-9195-d3aaa5ec8397 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:07.141023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cde90-b4c5-4e1d-9195-d3aaa5ec8397 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:07.245483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a370704-34b1-45a0-9bb9-7ffbae8b8b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:07.246168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a370704-34b1-45a0-9bb9-7ffbae8b8b68 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:07.248607 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a370704-34b1-45a0-9bb9-7ffbae8b8b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:07.248888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a370704-34b1-45a0-9bb9-7ffbae8b8b68 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:07.249637 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a370704-34b1-45a0-9bb9-7ffbae8b8b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:07.262324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a370704-34b1-45a0-9bb9-7ffbae8b8b68 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:07.296884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1165/2339] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:41:07 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:41:07.298591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f0ef6-5761-41a8-b748-235eb0472a61 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:07.314791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f0ef6-5761-41a8-b748-235eb0472a61 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:07.342536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb20ee-3a0a-4e1b-a36b-4bc51b3b1bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:07.343039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb20ee-3a0a-4e1b-a36b-4bc51b3b1bae admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:07.343328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb20ee-3a0a-4e1b-a36b-4bc51b3b1bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:07.343624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb20ee-3a0a-4e1b-a36b-4bc51b3b1bae admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:07.344391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb20ee-3a0a-4e1b-a36b-4bc51b3b1bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:07.346978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb20ee-3a0a-4e1b-a36b-4bc51b3b1bae admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:07.385910 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1175/2340] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:07.387359 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a370704-34b1-45a0-9bb9-7ffbae8b8b68 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:07.400595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a370704-34b1-45a0-9bb9-7ffbae8b8b68 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:07.405399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8695-330d-4cef-a034-2dc0f8cc3276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:07.406286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8695-330d-4cef-a034-2dc0f8cc3276 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:07.406560 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8695-330d-4cef-a034-2dc0f8cc3276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:07.406829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8695-330d-4cef-a034-2dc0f8cc3276 admin admin] PATH_INFO: `/v3/projects/ca7ec036aba14f5c847745f7dac65580/users/e0886bb8a261465197b6f21c008cb6a1/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:07.431871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8695-330d-4cef-a034-2dc0f8cc3276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7ec036aba14f5c847745f7dac65580, user_id=e0886bb8a261465197b6f21c008cb6a1, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:07.436090 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8695-330d-4cef-a034-2dc0f8cc3276 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:07.477315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1166/2341] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:41:07 2022] PUT /identity/v3/projects/ca7ec036aba14f5c847745f7dac65580/users/e0886bb8a261465197b6f21c008cb6a1/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:07.478961 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb20ee-3a0a-4e1b-a36b-4bc51b3b1bae admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:07.505925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb20ee-3a0a-4e1b-a36b-4bc51b3b1bae admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:07.615205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964526c-e18e-4c67-8827-627781cf2a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:07.616172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964526c-e18e-4c67-8827-627781cf2a57 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:07.616172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964526c-e18e-4c67-8827-627781cf2a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:07.616458 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964526c-e18e-4c67-8827-627781cf2a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:07.617125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964526c-e18e-4c67-8827-627781cf2a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:07.618748 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964526c-e18e-4c67-8827-627781cf2a57 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:07.646847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8695-330d-4cef-a034-2dc0f8cc3276 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:07.647398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1176/2342] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:07.658949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8695-330d-4cef-a034-2dc0f8cc3276 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:07.692859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe5edf-2a77-4674-b22e-4eaac8bcbe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:07.693833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe5edf-2a77-4674-b22e-4eaac8bcbe98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:07.694110 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe5edf-2a77-4674-b22e-4eaac8bcbe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:07.694377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe5edf-2a77-4674-b22e-4eaac8bcbe98 admin admin] PATH_INFO: `/v3/projects/ca7ec036aba14f5c847745f7dac65580/users/e0886bb8a261465197b6f21c008cb6a1/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:07.697861 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe5edf-2a77-4674-b22e-4eaac8bcbe98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7ec036aba14f5c847745f7dac65580, user_id=e0886bb8a261465197b6f21c008cb6a1, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:07.701221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe5edf-2a77-4674-b22e-4eaac8bcbe98 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:07.789053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ccfc-ac9a-4d22-95fc-adbcbb921002 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:07.789640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ccfc-ac9a-4d22-95fc-adbcbb921002 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:07.790322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ccfc-ac9a-4d22-95fc-adbcbb921002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:07.793212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1167/2343] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:41:07 2022] PUT /identity/v3/projects/ca7ec036aba14f5c847745f7dac65580/users/e0886bb8a261465197b6f21c008cb6a1/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:41:07.870078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-fea6ccfc-ac9a-4d22-95fc-adbcbb921002 None None] MFA Rules not processed for user `e0886bb8a261465197b6f21c008cb6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:07.871804 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fea6ccfc-ac9a-4d22-95fc-adbcbb921002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:08.000279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1177/2344] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:08.008842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe5edf-2a77-4674-b22e-4eaac8bcbe98 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:08.013904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c3fe5edf-2a77-4674-b22e-4eaac8bcbe98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:08.130454 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe5edf-2a77-4674-b22e-4eaac8bcbe98 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:08.143701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946fbe-4879-4b8e-9827-70dd8a133b6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:08.144410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946fbe-4879-4b8e-9827-70dd8a133b6c service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:08.144701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946fbe-4879-4b8e-9827-70dd8a133b6c service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:08.144975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946fbe-4879-4b8e-9827-70dd8a133b6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:08.229488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946fbe-4879-4b8e-9827-70dd8a133b6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:08.231782 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946fbe-4879-4b8e-9827-70dd8a133b6c service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:08.256295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1168/2345] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:11.043145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcd74d-69b8-4fa4-8512-4627f7eb1a0b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:11.043736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcd74d-69b8-4fa4-8512-4627f7eb1a0b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:11.043736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcd74d-69b8-4fa4-8512-4627f7eb1a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:11.076909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-60bcd74d-69b8-4fa4-8512-4627f7eb1a0b None None] MFA Rules not processed for user `9e3ca0cfe4ad49bd90027a7ea95bf024`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:11.082363 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-60bcd74d-69b8-4fa4-8512-4627f7eb1a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:11.155950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1178/2346] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:11.161034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946fbe-4879-4b8e-9827-70dd8a133b6c service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:11.162487 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7f946fbe-4879-4b8e-9827-70dd8a133b6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:11.233789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946fbe-4879-4b8e-9827-70dd8a133b6c service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:11.239861 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15c034-6b26-42f6-935b-968eea0735f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:11.240527 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15c034-6b26-42f6-935b-968eea0735f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:11.240806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15c034-6b26-42f6-935b-968eea0735f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:11.241084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15c034-6b26-42f6-935b-968eea0735f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:11.241810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15c034-6b26-42f6-935b-968eea0735f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:11.243887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15c034-6b26-42f6-935b-968eea0735f4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:11.279141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1169/2347] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:41:11 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:11.280428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcd74d-69b8-4fa4-8512-4627f7eb1a0b None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:11.297472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcd74d-69b8-4fa4-8512-4627f7eb1a0b None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:11.359503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6326cbb-2f83-4cd6-ab26-49b04c21f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:11.360168 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6326cbb-2f83-4cd6-ab26-49b04c21f90f admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:11.360448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6326cbb-2f83-4cd6-ab26-49b04c21f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:11.360721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6326cbb-2f83-4cd6-ab26-49b04c21f90f admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:11.361398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6326cbb-2f83-4cd6-ab26-49b04c21f90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:11.363351 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6326cbb-2f83-4cd6-ab26-49b04c21f90f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:11.381918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1179/2348] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:41:11 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:11.385812 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15c034-6b26-42f6-935b-968eea0735f4 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:11.395732 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15c034-6b26-42f6-935b-968eea0735f4 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:11.400242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de5521-17e7-4cc4-af52-8acb93eacafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:11.400881 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de5521-17e7-4cc4-af52-8acb93eacafb admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:11.401154 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de5521-17e7-4cc4-af52-8acb93eacafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:11.401438 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de5521-17e7-4cc4-af52-8acb93eacafb admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:11.402128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de5521-17e7-4cc4-af52-8acb93eacafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:11.404264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de5521-17e7-4cc4-af52-8acb93eacafb admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:11.414888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1170/2349] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:11.418690 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6326cbb-2f83-4cd6-ab26-49b04c21f90f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:11.428999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6326cbb-2f83-4cd6-ab26-49b04c21f90f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:11.433772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151bfed-2e2f-4eac-836e-3f4612b00366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:11.434662 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151bfed-2e2f-4eac-836e-3f4612b00366 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:11.434967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151bfed-2e2f-4eac-836e-3f4612b00366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:11.435242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151bfed-2e2f-4eac-836e-3f4612b00366 admin admin] PATH_INFO: `/v3/projects/05ea1336781645b3a0c5f6e199e3648e/users/785d7eaa939741e487db240e69fd1b0d/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:11.449672 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151bfed-2e2f-4eac-836e-3f4612b00366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ea1336781645b3a0c5f6e199e3648e, user_id=785d7eaa939741e487db240e69fd1b0d, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:11.452379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151bfed-2e2f-4eac-836e-3f4612b00366 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:11.464905 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1180/2350] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:41:11 2022] PUT /identity/v3/projects/05ea1336781645b3a0c5f6e199e3648e/users/785d7eaa939741e487db240e69fd1b0d/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:11.469327 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de5521-17e7-4cc4-af52-8acb93eacafb admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:11.478892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de5521-17e7-4cc4-af52-8acb93eacafb admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:11.545017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f30f57-fcf1-4360-9aa2-722cdc9ba25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:11.545681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f30f57-fcf1-4360-9aa2-722cdc9ba25b admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:11.545963 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f30f57-fcf1-4360-9aa2-722cdc9ba25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:11.546237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f30f57-fcf1-4360-9aa2-722cdc9ba25b admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:11.546997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f30f57-fcf1-4360-9aa2-722cdc9ba25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:11.548632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f30f57-fcf1-4360-9aa2-722cdc9ba25b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:11.558215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1171/2351] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:11.562844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151bfed-2e2f-4eac-836e-3f4612b00366 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:11.573059 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151bfed-2e2f-4eac-836e-3f4612b00366 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:11.578372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fa4db-5757-46c4-96ea-e5d93ea0b521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:11.579267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fa4db-5757-46c4-96ea-e5d93ea0b521 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:11.579546 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fa4db-5757-46c4-96ea-e5d93ea0b521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:11.579824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fa4db-5757-46c4-96ea-e5d93ea0b521 admin admin] PATH_INFO: `/v3/projects/05ea1336781645b3a0c5f6e199e3648e/users/785d7eaa939741e487db240e69fd1b0d/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:11.581797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fa4db-5757-46c4-96ea-e5d93ea0b521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ea1336781645b3a0c5f6e199e3648e, user_id=785d7eaa939741e487db240e69fd1b0d, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:11.584432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fa4db-5757-46c4-96ea-e5d93ea0b521 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:11.594524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1181/2352] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:41:11 2022] PUT /identity/v3/projects/05ea1336781645b3a0c5f6e199e3648e/users/785d7eaa939741e487db240e69fd1b0d/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:18.414546 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59b2d3-383e-4286-b130-bbc692361c6e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:18.415844 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59b2d3-383e-4286-b130-bbc692361c6e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:18.415844 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59b2d3-383e-4286-b130-bbc692361c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:18.463802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-cf59b2d3-383e-4286-b130-bbc692361c6e None None] MFA Rules not processed for user `785d7eaa939741e487db240e69fd1b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:18.465046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-cf59b2d3-383e-4286-b130-bbc692361c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:18.574556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1172/2353] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:18.580284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fa4db-5757-46c4-96ea-e5d93ea0b521 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:18.584315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-089fa4db-5757-46c4-96ea-e5d93ea0b521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:18.754788 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fa4db-5757-46c4-96ea-e5d93ea0b521 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:18.760888 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413c2ad-a0f4-42f9-b079-5259c7e579e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:18.761604 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c2ad-a0f4-42f9-b079-5259c7e579e3 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:18.761957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c2ad-a0f4-42f9-b079-5259c7e579e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:18.770729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c2ad-a0f4-42f9-b079-5259c7e579e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:18.834931 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413c2ad-a0f4-42f9-b079-5259c7e579e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:18.836727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413c2ad-a0f4-42f9-b079-5259c7e579e3 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:18.847348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1182/2354] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:25.478234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59b2d3-383e-4286-b130-bbc692361c6e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:25.549259 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59b2d3-383e-4286-b130-bbc692361c6e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:25.554982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138a4cc-be06-4124-a31e-fdefd485397c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:25.555931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138a4cc-be06-4124-a31e-fdefd485397c service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:25.556214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138a4cc-be06-4124-a31e-fdefd485397c service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:25.556488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138a4cc-be06-4124-a31e-fdefd485397c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:25.623177 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138a4cc-be06-4124-a31e-fdefd485397c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:25.624888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138a4cc-be06-4124-a31e-fdefd485397c service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:25.635795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1173/2355] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:29.154263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413c2ad-a0f4-42f9-b079-5259c7e579e3 service nova] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:29.163623 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413c2ad-a0f4-42f9-b079-5259c7e579e3 service nova] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:29.167869 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9554e7-07c3-4e32-8419-132b132592c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:29.169154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9554e7-07c3-4e32-8419-132b132592c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:29.169717 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9554e7-07c3-4e32-8419-132b132592c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:29.170059 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9554e7-07c3-4e32-8419-132b132592c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:29.228177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9554e7-07c3-4e32-8419-132b132592c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:29.229525 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9554e7-07c3-4e32-8419-132b132592c5 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:29.239416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1183/2356] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:38.586390 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab9b6-270c-4f77-901f-d70491e5fd09 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:38.586934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab9b6-270c-4f77-901f-d70491e5fd09 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:38.587038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab9b6-270c-4f77-901f-d70491e5fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:38.635518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e89ab9b6-270c-4f77-901f-d70491e5fd09 None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:38.636874 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e89ab9b6-270c-4f77-901f-d70491e5fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:38.701836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1174/2357] 10.222.0.44 () {58 vars in 967 bytes} [Mon Feb 28 10:41:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:38.718766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9554e7-07c3-4e32-8419-132b132592c5 service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:38.718766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3c9554e7-07c3-4e32-8419-132b132592c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:38.826482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9554e7-07c3-4e32-8419-132b132592c5 service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:38.831830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86493e4-6e75-48c2-90fd-3b8d97c3efd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:38.832476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86493e4-6e75-48c2-90fd-3b8d97c3efd0 service swift] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:38.833189 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86493e4-6e75-48c2-90fd-3b8d97c3efd0 service swift] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:38.833189 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86493e4-6e75-48c2-90fd-3b8d97c3efd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:38.842868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86493e4-6e75-48c2-90fd-3b8d97c3efd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:38.844472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86493e4-6e75-48c2-90fd-3b8d97c3efd0 service swift] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:38.853385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1184/2358] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:41:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:41:48.160849 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ab9b6-270c-4f77-901f-d70491e5fd09 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:48.162336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e89ab9b6-270c-4f77-901f-d70491e5fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:48.228824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ab9b6-270c-4f77-901f-d70491e5fd09 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:48.234037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b48873-607d-46ad-89aa-0b80a52943e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:48.235494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b48873-607d-46ad-89aa-0b80a52943e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:48.235778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b48873-607d-46ad-89aa-0b80a52943e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:48.236053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b48873-607d-46ad-89aa-0b80a52943e7 admin admin] PATH_INFO: `/v3/users/2d4da73ac92b47f4b9d4b393dea47d64` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:48.237694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b48873-607d-46ad-89aa-0b80a52943e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4da73ac92b47f4b9d4b393dea47d64)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:48.239722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b48873-607d-46ad-89aa-0b80a52943e7 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:48.296755 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b48873-607d-46ad-89aa-0b80a52943e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4da73ac92b47f4b9d4b393dea47d64'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:48.297482 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b48873-607d-46ad-89aa-0b80a52943e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4da73ac92b47f4b9d4b393dea47d64'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:48.310642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b48873-607d-46ad-89aa-0b80a52943e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4da73ac92b47f4b9d4b393dea47d64'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:48.327955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b48873-607d-46ad-89aa-0b80a52943e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4da73ac92b47f4b9d4b393dea47d64'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:48.340124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b48873-607d-46ad-89aa-0b80a52943e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4da73ac92b47f4b9d4b393dea47d64'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:48.346950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1175/2359] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:41:48 2022] DELETE /identity/v3/users/2d4da73ac92b47f4b9d4b393dea47d64 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:41:48.534515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86493e4-6e75-48c2-90fd-3b8d97c3efd0 service swift] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:48.562223 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86493e4-6e75-48c2-90fd-3b8d97c3efd0 service swift] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:48.647819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:48.648741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:48.649079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:48.649392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] PATH_INFO: `/v3/projects/c6342293c1f74a629d3f9097a3815571` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:48.650692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6342293c1f74a629d3f9097a3815571)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:48.652937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:48.706224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6342293c1f74a629d3f9097a3815571', 'request_id': 'req-f1c5feac-5674-4a55-b372-d84898acc310'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:48.713515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6342293c1f74a629d3f9097a3815571', 'request_id': 'req-f1c5feac-5674-4a55-b372-d84898acc310'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:48.723288 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6342293c1f74a629d3f9097a3815571', 'request_id': 'req-f1c5feac-5674-4a55-b372-d84898acc310'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:48.735814 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] The token cache is being invalidate because project c6342293c1f74a629d3f9097a3815571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:41:48.736106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:48.736720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f1c5feac-5674-4a55-b372-d84898acc310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:48.738248 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1185/2360] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:41:48 2022] DELETE /identity/v3/projects/c6342293c1f74a629d3f9097a3815571 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:48.743061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebf74f-3dac-4cc4-8f92-6e2840b27c3c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:48.743406 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebf74f-3dac-4cc4-8f92-6e2840b27c3c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:48.743685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebf74f-3dac-4cc4-8f92-6e2840b27c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:48.761300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-53ebf74f-3dac-4cc4-8f92-6e2840b27c3c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:48.762504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-53ebf74f-3dac-4cc4-8f92-6e2840b27c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:48.835673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1176/2361] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:48.843051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f725-aad6-4881-be0c-deac81aac011 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:48.843344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f725-aad6-4881-be0c-deac81aac011 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:48.843624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f725-aad6-4881-be0c-deac81aac011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:48.862547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2a88f725-aad6-4881-be0c-deac81aac011 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:48.863780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2a88f725-aad6-4881-be0c-deac81aac011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:48.871694 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1186/2362] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:48.876321 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebf74f-3dac-4cc4-8f92-6e2840b27c3c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:48.886032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebf74f-3dac-4cc4-8f92-6e2840b27c3c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:48.891415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fce30-bfe2-4770-98c8-de7177d87bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:48.892052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fce30-bfe2-4770-98c8-de7177d87bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:48.892326 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fce30-bfe2-4770-98c8-de7177d87bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:48.892595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fce30-bfe2-4770-98c8-de7177d87bf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:48.893330 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fce30-bfe2-4770-98c8-de7177d87bf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:41:48.893628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fce30-bfe2-4770-98c8-de7177d87bf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:48.895844 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fce30-bfe2-4770-98c8-de7177d87bf7 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:48.907220 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1177/2363] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:41:48.911564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88f725-aad6-4881-be0c-deac81aac011 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:48.920332 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88f725-aad6-4881-be0c-deac81aac011 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:48.924868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483ba66-e11d-45b5-8cbb-0d74a0c6ea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:48.925494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483ba66-e11d-45b5-8cbb-0d74a0c6ea52 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:48.925768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483ba66-e11d-45b5-8cbb-0d74a0c6ea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:48.926036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483ba66-e11d-45b5-8cbb-0d74a0c6ea52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:48.926712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483ba66-e11d-45b5-8cbb-0d74a0c6ea52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:48.928605 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483ba66-e11d-45b5-8cbb-0d74a0c6ea52 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:48.954982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1187/2364] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:41:48 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:48.959257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fce30-bfe2-4770-98c8-de7177d87bf7 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:48.969852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fce30-bfe2-4770-98c8-de7177d87bf7 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:49.024149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57432d57-03a1-4746-9051-960ca3f5a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:49.024807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57432d57-03a1-4746-9051-960ca3f5a86d admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:49.025083 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57432d57-03a1-4746-9051-960ca3f5a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:49.025355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57432d57-03a1-4746-9051-960ca3f5a86d admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:49.026024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57432d57-03a1-4746-9051-960ca3f5a86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:49.027960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57432d57-03a1-4746-9051-960ca3f5a86d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:49.046657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1178/2365] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:41:48 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:41:49.050915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483ba66-e11d-45b5-8cbb-0d74a0c6ea52 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:49.061536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483ba66-e11d-45b5-8cbb-0d74a0c6ea52 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:49.066102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a45f6d-40db-475c-9755-43e7b37a8af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:49.066746 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45f6d-40db-475c-9755-43e7b37a8af6 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:49.067051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45f6d-40db-475c-9755-43e7b37a8af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:49.067335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45f6d-40db-475c-9755-43e7b37a8af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:49.068051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a45f6d-40db-475c-9755-43e7b37a8af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:49.069687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a45f6d-40db-475c-9755-43e7b37a8af6 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:49.086090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1188/2366] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:49.087473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57432d57-03a1-4746-9051-960ca3f5a86d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:49.097780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57432d57-03a1-4746-9051-960ca3f5a86d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:49.102468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215eeeba-945e-41c1-9952-0760af48e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:49.103165 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eeeba-945e-41c1-9952-0760af48e38b admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:49.103445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eeeba-945e-41c1-9952-0760af48e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:49.103720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eeeba-945e-41c1-9952-0760af48e38b admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:49.104440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215eeeba-945e-41c1-9952-0760af48e38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:49.106034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215eeeba-945e-41c1-9952-0760af48e38b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:49.115735 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1179/2367] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:49.119821 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a45f6d-40db-475c-9755-43e7b37a8af6 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:49.129970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a45f6d-40db-475c-9755-43e7b37a8af6 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:49.134739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c89cf9-7e72-4947-a61a-3fb14e18813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:49.135626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c89cf9-7e72-4947-a61a-3fb14e18813e admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:49.135909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c89cf9-7e72-4947-a61a-3fb14e18813e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:49.136174 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c89cf9-7e72-4947-a61a-3fb14e18813e admin admin] PATH_INFO: `/v3/projects/016568acc48f4c59899b72034f8fdf17/users/1333a271a3a94ac1a4e6c72abb7c8cbd/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:49.150538 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c89cf9-7e72-4947-a61a-3fb14e18813e admin admin] RBAC: Authorizing `identity:create_grant(project_id=016568acc48f4c59899b72034f8fdf17, user_id=1333a271a3a94ac1a4e6c72abb7c8cbd, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:49.153191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c89cf9-7e72-4947-a61a-3fb14e18813e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:49.165264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1189/2368] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:41:49 2022] PUT /identity/v3/projects/016568acc48f4c59899b72034f8fdf17/users/1333a271a3a94ac1a4e6c72abb7c8cbd/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:49.176611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef72f-a2bc-4d34-b0e6-35d098a420a6 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:49.177140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef72f-a2bc-4d34-b0e6-35d098a420a6 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:49.177140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef72f-a2bc-4d34-b0e6-35d098a420a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:49.203955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-284ef72f-a2bc-4d34-b0e6-35d098a420a6 None None] MFA Rules not processed for user `1333a271a3a94ac1a4e6c72abb7c8cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:49.205151 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-284ef72f-a2bc-4d34-b0e6-35d098a420a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:49.267517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1180/2369] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:41:49.278576 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c89cf9-7e72-4947-a61a-3fb14e18813e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:49.280245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-41c89cf9-7e72-4947-a61a-3fb14e18813e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:49.354832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c89cf9-7e72-4947-a61a-3fb14e18813e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:49.359375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33458321-7acd-4d0d-ba4d-4799448660d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ad61a348b2450baceb030f98150647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:49.360031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33458321-7acd-4d0d-ba4d-4799448660d6 service glance] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:49.360306 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33458321-7acd-4d0d-ba4d-4799448660d6 service glance] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:49.360572 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33458321-7acd-4d0d-ba4d-4799448660d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:49.369196 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33458321-7acd-4d0d-ba4d-4799448660d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:49.370607 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33458321-7acd-4d0d-ba4d-4799448660d6 service glance] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:49.379770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1190/2370] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:51.000999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ef72f-a2bc-4d34-b0e6-35d098a420a6 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:51.002417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-284ef72f-a2bc-4d34-b0e6-35d098a420a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:51.073900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ef72f-a2bc-4d34-b0e6-35d098a420a6 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:51.081680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c318a15-273c-4425-9840-8d437fc6a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:51.083805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318a15-273c-4425-9840-8d437fc6a850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:51.084369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318a15-273c-4425-9840-8d437fc6a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:51.085047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318a15-273c-4425-9840-8d437fc6a850 admin admin] PATH_INFO: `/v3/users/11447ff6f83a4a7a96d9549f3172764e` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:51.088252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c318a15-273c-4425-9840-8d437fc6a850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11447ff6f83a4a7a96d9549f3172764e)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:51.091555 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c318a15-273c-4425-9840-8d437fc6a850 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:51.095281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33458321-7acd-4d0d-ba4d-4799448660d6 service glance] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:51.097360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-33458321-7acd-4d0d-ba4d-4799448660d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:51.111695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33458321-7acd-4d0d-ba4d-4799448660d6 service glance] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:51.116453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad07f99-ab79-4e64-9827-39cf6d9f1883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:51.117703 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07f99-ab79-4e64-9827-39cf6d9f1883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:51.118253 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07f99-ab79-4e64-9827-39cf6d9f1883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:51.118634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07f99-ab79-4e64-9827-39cf6d9f1883 admin admin] PATH_INFO: `/v3/users/12bfd90e4c464ff68264867a11624098` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:51.120176 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad07f99-ab79-4e64-9827-39cf6d9f1883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bfd90e4c464ff68264867a11624098)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:51.122876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad07f99-ab79-4e64-9827-39cf6d9f1883 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:51.138394 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8c318a15-273c-4425-9840-8d437fc6a850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11447ff6f83a4a7a96d9549f3172764e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.139098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8c318a15-273c-4425-9840-8d437fc6a850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11447ff6f83a4a7a96d9549f3172764e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.151851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8c318a15-273c-4425-9840-8d437fc6a850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11447ff6f83a4a7a96d9549f3172764e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.160613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8c318a15-273c-4425-9840-8d437fc6a850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11447ff6f83a4a7a96d9549f3172764e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.168881 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8c318a15-273c-4425-9840-8d437fc6a850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11447ff6f83a4a7a96d9549f3172764e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.174885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1181/2371] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:41:50 2022] DELETE /identity/v3/users/11447ff6f83a4a7a96d9549f3172764e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:51.176958 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0ad07f99-ab79-4e64-9827-39cf6d9f1883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bfd90e4c464ff68264867a11624098'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.177594 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0ad07f99-ab79-4e64-9827-39cf6d9f1883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bfd90e4c464ff68264867a11624098'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.178466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0ad07f99-ab79-4e64-9827-39cf6d9f1883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bfd90e4c464ff68264867a11624098'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.179369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16a342-599f-4e24-96ba-af6f3fa3fdc7 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:51.179656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16a342-599f-4e24-96ba-af6f3fa3fdc7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:51.179931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16a342-599f-4e24-96ba-af6f3fa3fdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:51.191171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0ad07f99-ab79-4e64-9827-39cf6d9f1883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bfd90e4c464ff68264867a11624098'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.198154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-0ad07f99-ab79-4e64-9827-39cf6d9f1883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bfd90e4c464ff68264867a11624098'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.198893 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-eb16a342-599f-4e24-96ba-af6f3fa3fdc7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:51.200117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-eb16a342-599f-4e24-96ba-af6f3fa3fdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:51.210473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1191/2372] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:41:51 2022] DELETE /identity/v3/users/12bfd90e4c464ff68264867a11624098 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:41:51.215017 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4e979-0e6d-4bdd-8f70-fccc243a0f3a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:51.215332 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4e979-0e6d-4bdd-8f70-fccc243a0f3a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:51.215634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4e979-0e6d-4bdd-8f70-fccc243a0f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:51.234418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-4ac4e979-0e6d-4bdd-8f70-fccc243a0f3a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:51.235676 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4ac4e979-0e6d-4bdd-8f70-fccc243a0f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:51.264586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1182/2373] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:51.274470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16a342-599f-4e24-96ba-af6f3fa3fdc7 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:51.275863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-eb16a342-599f-4e24-96ba-af6f3fa3fdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:51.302892 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1192/2374] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:41:51.309482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4e979-0e6d-4bdd-8f70-fccc243a0f3a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:51.311480 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4ac4e979-0e6d-4bdd-8f70-fccc243a0f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:51.341612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16a342-599f-4e24-96ba-af6f3fa3fdc7 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:51.374439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4e979-0e6d-4bdd-8f70-fccc243a0f3a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:51.378722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0022f4-a7f1-41b3-b4a9-58c2dee95122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:51.379506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0022f4-a7f1-41b3-b4a9-58c2dee95122 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:51.379735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0022f4-a7f1-41b3-b4a9-58c2dee95122 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:51.380059 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0022f4-a7f1-41b3-b4a9-58c2dee95122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:51.390093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0022f4-a7f1-41b3-b4a9-58c2dee95122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:51.390747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27306fe-e156-4eea-bcd3-ed25a75cf43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:51.391412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27306fe-e156-4eea-bcd3-ed25a75cf43a service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:51.391560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0022f4-a7f1-41b3-b4a9-58c2dee95122 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:51.391685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27306fe-e156-4eea-bcd3-ed25a75cf43a service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:51.391953 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27306fe-e156-4eea-bcd3-ed25a75cf43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:51.400692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27306fe-e156-4eea-bcd3-ed25a75cf43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:51.401272 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1193/2375] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:41:51.402240 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27306fe-e156-4eea-bcd3-ed25a75cf43a service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:51.412391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1183/2376] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:41:51.772980 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0022f4-a7f1-41b3-b4a9-58c2dee95122 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:51.776389 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cd0022f4-a7f1-41b3-b4a9-58c2dee95122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:51.791052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0022f4-a7f1-41b3-b4a9-58c2dee95122 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:51.796339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:51.797232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:51.797444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:51.797736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] PATH_INFO: `/v3/projects/3a11b92e88664251b219068ea7a06b2a` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:51.799028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a11b92e88664251b219068ea7a06b2a)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:51.801357 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:51.839395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27306fe-e156-4eea-bcd3-ed25a75cf43a service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:51.841517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f27306fe-e156-4eea-bcd3-ed25a75cf43a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:51.859354 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27306fe-e156-4eea-bcd3-ed25a75cf43a service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:51.862096 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a11b92e88664251b219068ea7a06b2a', 'request_id': 'req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.870119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a11b92e88664251b219068ea7a06b2a', 'request_id': 'req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.876914 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a11b92e88664251b219068ea7a06b2a', 'request_id': 'req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.897314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] The token cache is being invalidate because project 3a11b92e88664251b219068ea7a06b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:41:51.897793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.901891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:51.904867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1194/2377] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:41:51 2022] DELETE /identity/v3/projects/3a11b92e88664251b219068ea7a06b2a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:51.910167 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:51.911768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:51.951397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:51.952456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:51.952944 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:51.953216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] PATH_INFO: `/v3/projects/cf63b36d323a4daa837292f52f9f9d4f` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:51.954426 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf63b36d323a4daa837292f52f9f9d4f)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:51.956401 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:51.986951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0ceb5-c75c-42c9-97e1-38501d7804e5 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:51.991836 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:51.992687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:51.992969 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:51.993241 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] PATH_INFO: `/v3/users/73f64223586e49c098a0ef0470518a24` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:51.994432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f64223586e49c098a0ef0470518a24)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:51.996376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:52.002643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf63b36d323a4daa837292f52f9f9d4f', 'request_id': 'req-a31ab197-be34-47e4-9305-feb5aa179003'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.008171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf63b36d323a4daa837292f52f9f9d4f', 'request_id': 'req-a31ab197-be34-47e4-9305-feb5aa179003'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.014343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf63b36d323a4daa837292f52f9f9d4f', 'request_id': 'req-a31ab197-be34-47e4-9305-feb5aa179003'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.027348 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] The token cache is being invalidate because project cf63b36d323a4daa837292f52f9f9d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:41:52.027721 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.029024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.030822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1184/2378] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:41:51 2022] DELETE /identity/v3/projects/cf63b36d323a4daa837292f52f9f9d4f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:41:52.047200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f64223586e49c098a0ef0470518a24'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.047892 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f64223586e49c098a0ef0470518a24'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.048512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f64223586e49c098a0ef0470518a24'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.061735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f64223586e49c098a0ef0470518a24'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.069957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f64223586e49c098a0ef0470518a24'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.088575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1195/2379] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:41:51 2022] DELETE /identity/v3/users/73f64223586e49c098a0ef0470518a24 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:41:52.376111 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:52.377750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:52.447878 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ab197-be34-47e4-9305-feb5aa179003 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:52.501665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:52.502505 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:52.502778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:52.503081 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] PATH_INFO: `/v3/projects/7449871cabbd4638a5844671816a4327` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:52.504331 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7449871cabbd4638a5844671816a4327)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:52.506589 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:52.555538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7449871cabbd4638a5844671816a4327', 'request_id': 'req-e8356c54-b3dd-427a-a552-58f5f834c830'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.561218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7449871cabbd4638a5844671816a4327', 'request_id': 'req-e8356c54-b3dd-427a-a552-58f5f834c830'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.567209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7449871cabbd4638a5844671816a4327', 'request_id': 'req-e8356c54-b3dd-427a-a552-58f5f834c830'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.578950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] The token cache is being invalidate because project 7449871cabbd4638a5844671816a4327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:41:52.579189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.579791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.581340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1185/2380] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:41:52 2022] DELETE /identity/v3/projects/7449871cabbd4638a5844671816a4327 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:52.585423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:52.586818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:52.599933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d7742-3e9c-4dfe-9c9b-314e6883ca74 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:52.655697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18f007-db9b-421b-8e43-812a97ee0eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:52.656542 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f007-db9b-421b-8e43-812a97ee0eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:52.656819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f007-db9b-421b-8e43-812a97ee0eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:52.657086 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f007-db9b-421b-8e43-812a97ee0eb1 admin admin] PATH_INFO: `/v3/users/e0886bb8a261465197b6f21c008cb6a1` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:52.658244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18f007-db9b-421b-8e43-812a97ee0eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0886bb8a261465197b6f21c008cb6a1)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:52.660166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18f007-db9b-421b-8e43-812a97ee0eb1 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:52.702110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5a18f007-db9b-421b-8e43-812a97ee0eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0886bb8a261465197b6f21c008cb6a1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.702739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5a18f007-db9b-421b-8e43-812a97ee0eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0886bb8a261465197b6f21c008cb6a1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.703375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5a18f007-db9b-421b-8e43-812a97ee0eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0886bb8a261465197b6f21c008cb6a1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.715358 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5a18f007-db9b-421b-8e43-812a97ee0eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0886bb8a261465197b6f21c008cb6a1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.723679 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5a18f007-db9b-421b-8e43-812a97ee0eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0886bb8a261465197b6f21c008cb6a1'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:52.737772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1196/2381] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:41:52 2022] DELETE /identity/v3/users/e0886bb8a261465197b6f21c008cb6a1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:53.008283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:53.009805 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:53.022779 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8356c54-b3dd-427a-a552-58f5f834c830 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:53.086263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:53.087164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:53.087512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:53.087724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] PATH_INFO: `/v3/projects/ca7ec036aba14f5c847745f7dac65580` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:53.088944 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca7ec036aba14f5c847745f7dac65580)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:53.092265 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:53.139193 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca7ec036aba14f5c847745f7dac65580', 'request_id': 'req-f145b1cc-c0e5-4268-9758-1a200f8183c1'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:53.144272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca7ec036aba14f5c847745f7dac65580', 'request_id': 'req-f145b1cc-c0e5-4268-9758-1a200f8183c1'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:53.150442 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca7ec036aba14f5c847745f7dac65580', 'request_id': 'req-f145b1cc-c0e5-4268-9758-1a200f8183c1'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:53.164246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] The token cache is being invalidate because project ca7ec036aba14f5c847745f7dac65580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:41:53.164527 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:53.165127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f145b1cc-c0e5-4268-9758-1a200f8183c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:53.166641 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1186/2382] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:41:53 2022] DELETE /identity/v3/projects/ca7ec036aba14f5c847745f7dac65580 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:53.172397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400471d-8bd6-4e4a-86b5-f4ee3f90f588 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:53.172778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400471d-8bd6-4e4a-86b5-f4ee3f90f588 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:53.173054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400471d-8bd6-4e4a-86b5-f4ee3f90f588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:53.194994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-3400471d-8bd6-4e4a-86b5-f4ee3f90f588 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:53.196196 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3400471d-8bd6-4e4a-86b5-f4ee3f90f588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:53.263904 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1197/2383] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:41:53.272622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927f68-ed30-4af2-82ea-69b979d8387d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:53.272904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927f68-ed30-4af2-82ea-69b979d8387d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:53.273177 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927f68-ed30-4af2-82ea-69b979d8387d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:53.291788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-eb927f68-ed30-4af2-82ea-69b979d8387d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:53.292968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-eb927f68-ed30-4af2-82ea-69b979d8387d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:53.300796 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1187/2384] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:53.304983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400471d-8bd6-4e4a-86b5-f4ee3f90f588 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:53.315121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400471d-8bd6-4e4a-86b5-f4ee3f90f588 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:53.319796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b734258-20ce-4c8f-9940-988a6d1d51fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:53.320435 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b734258-20ce-4c8f-9940-988a6d1d51fe admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:53.320714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b734258-20ce-4c8f-9940-988a6d1d51fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:53.320989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b734258-20ce-4c8f-9940-988a6d1d51fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:53.321702 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b734258-20ce-4c8f-9940-988a6d1d51fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:41:53.322005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b734258-20ce-4c8f-9940-988a6d1d51fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:53.323639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b734258-20ce-4c8f-9940-988a6d1d51fe admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:53.339823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1198/2385] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:41:53.341084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927f68-ed30-4af2-82ea-69b979d8387d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:53.350247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927f68-ed30-4af2-82ea-69b979d8387d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:53.354779 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c85e3d-67e1-4f9d-901a-88fc85d51cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:53.355446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85e3d-67e1-4f9d-901a-88fc85d51cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:53.355723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85e3d-67e1-4f9d-901a-88fc85d51cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:53.355990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85e3d-67e1-4f9d-901a-88fc85d51cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:53.356662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c85e3d-67e1-4f9d-901a-88fc85d51cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:53.358553 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c85e3d-67e1-4f9d-901a-88fc85d51cf1 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:53.383817 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1188/2386] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:41:53 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:53.388465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b734258-20ce-4c8f-9940-988a6d1d51fe admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:53.398072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b734258-20ce-4c8f-9940-988a6d1d51fe admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:53.455123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedd693-f2be-40fd-a1ad-5ed95093e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:53.455821 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedd693-f2be-40fd-a1ad-5ed95093e2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:53.456101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedd693-f2be-40fd-a1ad-5ed95093e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:53.456373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedd693-f2be-40fd-a1ad-5ed95093e2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:53.457059 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedd693-f2be-40fd-a1ad-5ed95093e2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:53.459010 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedd693-f2be-40fd-a1ad-5ed95093e2a9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:53.480694 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1199/2387] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:41:53 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:41:53.484934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c85e3d-67e1-4f9d-901a-88fc85d51cf1 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:53.495160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c85e3d-67e1-4f9d-901a-88fc85d51cf1 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:53.500229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a22fb1-1a03-4c89-932e-0f7dcd95a3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:53.500873 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a22fb1-1a03-4c89-932e-0f7dcd95a3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:53.501149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a22fb1-1a03-4c89-932e-0f7dcd95a3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:53.501419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a22fb1-1a03-4c89-932e-0f7dcd95a3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:53.502134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a22fb1-1a03-4c89-932e-0f7dcd95a3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:53.503747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a22fb1-1a03-4c89-932e-0f7dcd95a3ff admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:53.515402 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1189/2388] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:53.519187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedd693-f2be-40fd-a1ad-5ed95093e2a9 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:53.529465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedd693-f2be-40fd-a1ad-5ed95093e2a9 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:53.534001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad40bfa-7306-466f-afd2-93c4b8a91d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:53.534637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad40bfa-7306-466f-afd2-93c4b8a91d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:53.534926 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad40bfa-7306-466f-afd2-93c4b8a91d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:53.535210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad40bfa-7306-466f-afd2-93c4b8a91d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:53.535916 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad40bfa-7306-466f-afd2-93c4b8a91d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:53.537492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad40bfa-7306-466f-afd2-93c4b8a91d6d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:53.547745 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1200/2389] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:41:53.551882 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a22fb1-1a03-4c89-932e-0f7dcd95a3ff admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:53.562238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a22fb1-1a03-4c89-932e-0f7dcd95a3ff admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:53.566858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5188564-86fe-4094-9e7f-fa2f46ea8487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:53.567746 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5188564-86fe-4094-9e7f-fa2f46ea8487 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:53.568023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5188564-86fe-4094-9e7f-fa2f46ea8487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:53.568290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5188564-86fe-4094-9e7f-fa2f46ea8487 admin admin] PATH_INFO: `/v3/projects/f733426cd7ff41e1a3da5ef28afacdb3/users/93f9bfbc6c724f4ab3b6cbd9d4a2219c/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:53.582918 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5188564-86fe-4094-9e7f-fa2f46ea8487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f733426cd7ff41e1a3da5ef28afacdb3, user_id=93f9bfbc6c724f4ab3b6cbd9d4a2219c, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:53.585579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5188564-86fe-4094-9e7f-fa2f46ea8487 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:53.598965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1190/2390] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:41:53 2022] PUT /identity/v3/projects/f733426cd7ff41e1a3da5ef28afacdb3/users/93f9bfbc6c724f4ab3b6cbd9d4a2219c/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:53.609555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f1ef-a424-47ee-aefe-01a2fd9e8f99 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:53.610025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f1ef-a424-47ee-aefe-01a2fd9e8f99 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:53.610114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f1ef-a424-47ee-aefe-01a2fd9e8f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:53.635776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-f569f1ef-a424-47ee-aefe-01a2fd9e8f99 None None] MFA Rules not processed for user `93f9bfbc6c724f4ab3b6cbd9d4a2219c`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:53.636957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f569f1ef-a424-47ee-aefe-01a2fd9e8f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:53.697969 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1201/2391] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:53.709736 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5188564-86fe-4094-9e7f-fa2f46ea8487 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:53.711750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d5188564-86fe-4094-9e7f-fa2f46ea8487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:53.767861 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5188564-86fe-4094-9e7f-fa2f46ea8487 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:53.771518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddeaba-f978-4f0e-9a31-4e10e706b421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:53.772149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddeaba-f978-4f0e-9a31-4e10e706b421 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:53.772512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddeaba-f978-4f0e-9a31-4e10e706b421 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:53.772837 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddeaba-f978-4f0e-9a31-4e10e706b421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:53.782481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddeaba-f978-4f0e-9a31-4e10e706b421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:53.783987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddeaba-f978-4f0e-9a31-4e10e706b421 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:53.793232 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1191/2392] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:57.423838 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569f1ef-a424-47ee-aefe-01a2fd9e8f99 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:57.485074 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569f1ef-a424-47ee-aefe-01a2fd9e8f99 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:57.489613 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:57.490468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:57.490749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:57.491061 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] PATH_INFO: `/v3/users/93f9bfbc6c724f4ab3b6cbd9d4a2219c` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:57.492250 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f9bfbc6c724f4ab3b6cbd9d4a2219c)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:57.494174 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:57.540389 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f9bfbc6c724f4ab3b6cbd9d4a2219c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:57.541020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f9bfbc6c724f4ab3b6cbd9d4a2219c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:57.541663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f9bfbc6c724f4ab3b6cbd9d4a2219c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:57.553134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f9bfbc6c724f4ab3b6cbd9d4a2219c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:57.560636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f9bfbc6c724f4ab3b6cbd9d4a2219c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:57.573149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1202/2393] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:41:57 2022] DELETE /identity/v3/users/93f9bfbc6c724f4ab3b6cbd9d4a2219c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:57.578178 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fdce7-773c-4439-8572-e8c6dca708b4 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:57.578633 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fdce7-773c-4439-8572-e8c6dca708b4 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:57.578751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fdce7-773c-4439-8572-e8c6dca708b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:57.595890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-d61fdce7-773c-4439-8572-e8c6dca708b4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:57.597066 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d61fdce7-773c-4439-8572-e8c6dca708b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:57.656679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1192/2394] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:57.666033 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:57.667446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:57.723453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f70943-e676-4609-aa59-c2277af167c5 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:57.727050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a98d4-a033-4105-9263-0a7956d85775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:57.727684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a98d4-a033-4105-9263-0a7956d85775 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:57.727967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a98d4-a033-4105-9263-0a7956d85775 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:57.728242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a98d4-a033-4105-9263-0a7956d85775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:57.737141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a98d4-a033-4105-9263-0a7956d85775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:57.738555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a98d4-a033-4105-9263-0a7956d85775 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:57.748521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1203/2395] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:58.013357 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fdce7-773c-4439-8572-e8c6dca708b4 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:58.014777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d61fdce7-773c-4439-8572-e8c6dca708b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:58.027629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fdce7-773c-4439-8572-e8c6dca708b4 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:58.032336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:58.033184 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:58.033462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:58.033738 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] PATH_INFO: `/v3/projects/f733426cd7ff41e1a3da5ef28afacdb3` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:58.035180 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f733426cd7ff41e1a3da5ef28afacdb3)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:58.037397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:58.086956 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f733426cd7ff41e1a3da5ef28afacdb3', 'request_id': 'req-6e7cc9d3-4dc4-443b-992c-e28008f44080'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:58.092681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f733426cd7ff41e1a3da5ef28afacdb3', 'request_id': 'req-6e7cc9d3-4dc4-443b-992c-e28008f44080'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:58.098895 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f733426cd7ff41e1a3da5ef28afacdb3', 'request_id': 'req-6e7cc9d3-4dc4-443b-992c-e28008f44080'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:58.110881 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] The token cache is being invalidate because project f733426cd7ff41e1a3da5ef28afacdb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:41:58.111191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:58.111788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-6e7cc9d3-4dc4-443b-992c-e28008f44080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:58.113276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1193/2396] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:41:58 2022] DELETE /identity/v3/projects/f733426cd7ff41e1a3da5ef28afacdb3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:03.706594 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a98d4-a033-4105-9263-0a7956d85775 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:03.707995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a33a98d4-a033-4105-9263-0a7956d85775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:03.800051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a98d4-a033-4105-9263-0a7956d85775 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:03.864183 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896393f9-552d-4baa-b84b-934f23953fd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee30c8013ebb40a99d1eac7820d7f1f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:03.864818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896393f9-552d-4baa-b84b-934f23953fd2 service placement] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:03.865094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896393f9-552d-4baa-b84b-934f23953fd2 service placement] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:03.865362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896393f9-552d-4baa-b84b-934f23953fd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:03.867150 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-896393f9-552d-4baa-b84b-934f23953fd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:03.878740 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896393f9-552d-4baa-b84b-934f23953fd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:03.880330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896393f9-552d-4baa-b84b-934f23953fd2 service placement] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:03.890851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1204/2397] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:42:10.045445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfc47b-78ea-4c3b-9a90-074e185e412a None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:10.045934 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfc47b-78ea-4c3b-9a90-074e185e412a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:10.046052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfc47b-78ea-4c3b-9a90-074e185e412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:10.063183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-b9bfc47b-78ea-4c3b-9a90-074e185e412a None None] MFA Rules not processed for user `9e3ca0cfe4ad49bd90027a7ea95bf024`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:10.064374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b9bfc47b-78ea-4c3b-9a90-074e185e412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:10.119320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1194/2398] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:42:26.318152 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728c196-b129-484f-a714-f7875653ec92 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:26.318663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728c196-b129-484f-a714-f7875653ec92 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:26.318772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728c196-b129-484f-a714-f7875653ec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:26.336059 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6728c196-b129-484f-a714-f7875653ec92 None None] MFA Rules not processed for user `3b5e3d104f1c4a0ba55f9121bc3a0250`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:26.337246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6728c196-b129-484f-a714-f7875653ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:26.390124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1205/2399] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:42:51.407835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfc47b-78ea-4c3b-9a90-074e185e412a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:51.409389 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b9bfc47b-78ea-4c3b-9a90-074e185e412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:51.513676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfc47b-78ea-4c3b-9a90-074e185e412a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:51.520502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:51.520931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:51.521662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:51.522036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] PATH_INFO: `/v3/users/1333a271a3a94ac1a4e6c72abb7c8cbd` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:51.523923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1333a271a3a94ac1a4e6c72abb7c8cbd)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:51.528606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:51.607635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1333a271a3a94ac1a4e6c72abb7c8cbd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:51.608636 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1333a271a3a94ac1a4e6c72abb7c8cbd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:51.625352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1333a271a3a94ac1a4e6c72abb7c8cbd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:51.635892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1333a271a3a94ac1a4e6c72abb7c8cbd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:51.670098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1333a271a3a94ac1a4e6c72abb7c8cbd'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:51.684957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1195/2400] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:42:51 2022] DELETE /identity/v3/users/1333a271a3a94ac1a4e6c72abb7c8cbd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:51.689246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5b5de-bca4-4830-8f0c-d8c511de4c2a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:51.689767 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5b5de-bca4-4830-8f0c-d8c511de4c2a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:51.689767 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5b5de-bca4-4830-8f0c-d8c511de4c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:51.721339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-7ee5b5de-bca4-4830-8f0c-d8c511de4c2a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:51.723096 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7ee5b5de-bca4-4830-8f0c-d8c511de4c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:51.794642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1206/2401] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:42:51.806793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:51.809269 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:51.879852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f51924-a1fe-4399-9b50-ea44af4408c0 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:51.884372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f82706-bd41-4d84-a8a8-4b4900879968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:51.885107 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f82706-bd41-4d84-a8a8-4b4900879968 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:51.885463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f82706-bd41-4d84-a8a8-4b4900879968 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:51.885807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f82706-bd41-4d84-a8a8-4b4900879968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:51.910986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f82706-bd41-4d84-a8a8-4b4900879968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:51.915071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f82706-bd41-4d84-a8a8-4b4900879968 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:51.930884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1196/2402] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:42:52.358396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5b5de-bca4-4830-8f0c-d8c511de4c2a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:52.360453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7ee5b5de-bca4-4830-8f0c-d8c511de4c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:52.374017 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5b5de-bca4-4830-8f0c-d8c511de4c2a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:52.379692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:52.386043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:52.386556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:52.387159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] PATH_INFO: `/v3/projects/016568acc48f4c59899b72034f8fdf17` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:52.389143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016568acc48f4c59899b72034f8fdf17)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:52.391299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:52.461254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016568acc48f4c59899b72034f8fdf17', 'request_id': 'req-f6b0c028-1455-4f1e-b598-9089d6010637'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:52.469310 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016568acc48f4c59899b72034f8fdf17', 'request_id': 'req-f6b0c028-1455-4f1e-b598-9089d6010637'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:52.476347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016568acc48f4c59899b72034f8fdf17', 'request_id': 'req-f6b0c028-1455-4f1e-b598-9089d6010637'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:52.490943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] The token cache is being invalidate because project 016568acc48f4c59899b72034f8fdf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:42:52.491466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:52.492114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:52.494503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1207/2403] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:42:52 2022] DELETE /identity/v3/projects/016568acc48f4c59899b72034f8fdf17 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:53.023606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f82706-bd41-4d84-a8a8-4b4900879968 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:53.025610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-75f82706-bd41-4d84-a8a8-4b4900879968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:53.039869 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f82706-bd41-4d84-a8a8-4b4900879968 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:53.101106 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c1614-f469-42b6-952e-f2edd24ef12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:53.101978 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c1614-f469-42b6-952e-f2edd24ef12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:53.102256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c1614-f469-42b6-952e-f2edd24ef12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:53.102524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c1614-f469-42b6-952e-f2edd24ef12f admin admin] PATH_INFO: `/v3/users/b17dd7414b474fcfb8406d11fef7e95d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:53.103739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c1614-f469-42b6-952e-f2edd24ef12f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17dd7414b474fcfb8406d11fef7e95d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:53.106223 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c1614-f469-42b6-952e-f2edd24ef12f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:53.168867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-270c1614-f469-42b6-952e-f2edd24ef12f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17dd7414b474fcfb8406d11fef7e95d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:53.170528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-270c1614-f469-42b6-952e-f2edd24ef12f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17dd7414b474fcfb8406d11fef7e95d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:53.186114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-270c1614-f469-42b6-952e-f2edd24ef12f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17dd7414b474fcfb8406d11fef7e95d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:53.196875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-270c1614-f469-42b6-952e-f2edd24ef12f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17dd7414b474fcfb8406d11fef7e95d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:53.205575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-270c1614-f469-42b6-952e-f2edd24ef12f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17dd7414b474fcfb8406d11fef7e95d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:53.213223 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1197/2404] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:42:53 2022] DELETE /identity/v3/users/b17dd7414b474fcfb8406d11fef7e95d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:53.420495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:53.422442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:53.451217 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0c028-1455-4f1e-b598-9089d6010637 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:53.517503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:53.518616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:53.519016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:53.519299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] PATH_INFO: `/v3/projects/4151886992af47f89a22d8119c3ffd94` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:53.520491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4151886992af47f89a22d8119c3ffd94)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:53.522382 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:53.568835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4151886992af47f89a22d8119c3ffd94', 'request_id': 'req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:53.575197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4151886992af47f89a22d8119c3ffd94', 'request_id': 'req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:53.581391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4151886992af47f89a22d8119c3ffd94', 'request_id': 'req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:53.595160 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] The token cache is being invalidate because project 4151886992af47f89a22d8119c3ffd94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:42:53.595454 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:53.596098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5e55b04f-0999-4acc-b5aa-1435f9ab9d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:53.598975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1208/2405] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:42:53 2022] DELETE /identity/v3/projects/4151886992af47f89a22d8119c3ffd94 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:53.602627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985cf9-89ed-4501-9b67-d308733febfc None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:53.602954 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985cf9-89ed-4501-9b67-d308733febfc None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:53.603233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985cf9-89ed-4501-9b67-d308733febfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:53.623368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-17985cf9-89ed-4501-9b67-d308733febfc None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:53.624564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-17985cf9-89ed-4501-9b67-d308733febfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:53.685046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1198/2406] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:42:53.693203 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ab9ed-e184-4bd9-b672-cb9c538878a0 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:53.693494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ab9ed-e184-4bd9-b672-cb9c538878a0 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:53.693771 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ab9ed-e184-4bd9-b672-cb9c538878a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:53.712224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-a49ab9ed-e184-4bd9-b672-cb9c538878a0 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:53.713429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a49ab9ed-e184-4bd9-b672-cb9c538878a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:53.721439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1209/2407] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:42:53.725616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17985cf9-89ed-4501-9b67-d308733febfc None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:53.735582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17985cf9-89ed-4501-9b67-d308733febfc None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:53.740313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fede1c-2e57-42f8-9a43-23436721d1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:53.741033 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fede1c-2e57-42f8-9a43-23436721d1af admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:53.741304 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fede1c-2e57-42f8-9a43-23436721d1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:53.741567 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fede1c-2e57-42f8-9a43-23436721d1af admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:53.742332 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fede1c-2e57-42f8-9a43-23436721d1af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:42:53.742629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fede1c-2e57-42f8-9a43-23436721d1af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:53.744261 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fede1c-2e57-42f8-9a43-23436721d1af admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:53.758252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1199/2408] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:42:53.762675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ab9ed-e184-4bd9-b672-cb9c538878a0 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:53.776330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ab9ed-e184-4bd9-b672-cb9c538878a0 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:53.781507 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb678a4a-eedf-4f0e-bbfe-21b369022e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:53.782247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb678a4a-eedf-4f0e-bbfe-21b369022e63 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:53.782595 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb678a4a-eedf-4f0e-bbfe-21b369022e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:53.783517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb678a4a-eedf-4f0e-bbfe-21b369022e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:53.784307 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb678a4a-eedf-4f0e-bbfe-21b369022e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:53.786270 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb678a4a-eedf-4f0e-bbfe-21b369022e63 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:53.819824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1210/2409] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:42:53 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:42:53.823421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fede1c-2e57-42f8-9a43-23436721d1af admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:53.834098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fede1c-2e57-42f8-9a43-23436721d1af admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:53.897649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba298b43-78a6-436c-b729-6af4a497df5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:53.899024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba298b43-78a6-436c-b729-6af4a497df5b admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:53.899602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba298b43-78a6-436c-b729-6af4a497df5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:53.899879 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba298b43-78a6-436c-b729-6af4a497df5b admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:53.900799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba298b43-78a6-436c-b729-6af4a497df5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:53.904732 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba298b43-78a6-436c-b729-6af4a497df5b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:53.933966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1200/2410] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:42:53 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:42:53.935584 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb678a4a-eedf-4f0e-bbfe-21b369022e63 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:53.946675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb678a4a-eedf-4f0e-bbfe-21b369022e63 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:53.952332 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f54d7-b07e-4afb-9e41-4e345cd7ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:53.952481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f54d7-b07e-4afb-9e41-4e345cd7ea3d admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:53.952865 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f54d7-b07e-4afb-9e41-4e345cd7ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:53.953356 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f54d7-b07e-4afb-9e41-4e345cd7ea3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:53.954171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f54d7-b07e-4afb-9e41-4e345cd7ea3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:53.955939 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f54d7-b07e-4afb-9e41-4e345cd7ea3d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:53.966952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1211/2411] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:42:53.970716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba298b43-78a6-436c-b729-6af4a497df5b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:53.981581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba298b43-78a6-436c-b729-6af4a497df5b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:53.987677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee5518-743f-4493-8ef6-4c4e2809d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:53.988506 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee5518-743f-4493-8ef6-4c4e2809d431 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:53.988788 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee5518-743f-4493-8ef6-4c4e2809d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:53.989136 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee5518-743f-4493-8ef6-4c4e2809d431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:53.989765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee5518-743f-4493-8ef6-4c4e2809d431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:53.991450 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee5518-743f-4493-8ef6-4c4e2809d431 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:54.002580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1201/2412] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:42:54.006675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f54d7-b07e-4afb-9e41-4e345cd7ea3d admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:54.017124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f54d7-b07e-4afb-9e41-4e345cd7ea3d admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:54.021757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075115d7-6bbe-4094-9bf2-e2e45ee4925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:54.022628 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075115d7-6bbe-4094-9bf2-e2e45ee4925e admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:54.022923 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075115d7-6bbe-4094-9bf2-e2e45ee4925e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:54.023290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075115d7-6bbe-4094-9bf2-e2e45ee4925e admin admin] PATH_INFO: `/v3/projects/df17121a1d0f4704ab1b6d556e0cc95c/users/4ca2de4fb1df4b42a2bf304982a24910/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:54.041890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075115d7-6bbe-4094-9bf2-e2e45ee4925e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df17121a1d0f4704ab1b6d556e0cc95c, user_id=4ca2de4fb1df4b42a2bf304982a24910, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:54.045553 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075115d7-6bbe-4094-9bf2-e2e45ee4925e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:54.063179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1212/2413] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:42:54 2022] PUT /identity/v3/projects/df17121a1d0f4704ab1b6d556e0cc95c/users/4ca2de4fb1df4b42a2bf304982a24910/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:42:54.071580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aabed-1856-4e0a-a4ab-636fd5ce3b92 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:54.072118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aabed-1856-4e0a-a4ab-636fd5ce3b92 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:54.072118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aabed-1856-4e0a-a4ab-636fd5ce3b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:54.107280 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c28aabed-1856-4e0a-a4ab-636fd5ce3b92 None None] MFA Rules not processed for user `4ca2de4fb1df4b42a2bf304982a24910`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:54.108710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c28aabed-1856-4e0a-a4ab-636fd5ce3b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:54.177729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1202/2414] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:42:54.182429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075115d7-6bbe-4094-9bf2-e2e45ee4925e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:54.257970 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075115d7-6bbe-4094-9bf2-e2e45ee4925e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:54.263804 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8901a-ab22-4c5b-bdc5-81c2b4d97a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:54.264518 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8901a-ab22-4c5b-bdc5-81c2b4d97a8e admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:54.264862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8901a-ab22-4c5b-bdc5-81c2b4d97a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:54.265135 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8901a-ab22-4c5b-bdc5-81c2b4d97a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:54.275277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8901a-ab22-4c5b-bdc5-81c2b4d97a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:54.281753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8901a-ab22-4c5b-bdc5-81c2b4d97a8e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:54.328180 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1213/2415] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:42:54 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:42:54.332319 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aabed-1856-4e0a-a4ab-636fd5ce3b92 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:54.348804 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aabed-1856-4e0a-a4ab-636fd5ce3b92 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:54.432444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c926c-8833-4515-973e-903929d8401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:54.433249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c926c-8833-4515-973e-903929d8401b admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:54.433618 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c926c-8833-4515-973e-903929d8401b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:54.433888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c926c-8833-4515-973e-903929d8401b admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:54.434575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c926c-8833-4515-973e-903929d8401b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:54.436587 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c926c-8833-4515-973e-903929d8401b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:54.463677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1203/2416] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:42:54 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:42:54.468702 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8901a-ab22-4c5b-bdc5-81c2b4d97a8e admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:54.482378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8901a-ab22-4c5b-bdc5-81c2b4d97a8e admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:54.488295 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2bf65-cd67-4187-97fe-250d582a038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:54.489072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2bf65-cd67-4187-97fe-250d582a038e admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:54.489915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2bf65-cd67-4187-97fe-250d582a038e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:54.490574 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2bf65-cd67-4187-97fe-250d582a038e admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:54.491422 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2bf65-cd67-4187-97fe-250d582a038e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:54.493617 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2bf65-cd67-4187-97fe-250d582a038e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:54.508422 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1214/2417] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:42:54.513120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c926c-8833-4515-973e-903929d8401b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:54.525244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c926c-8833-4515-973e-903929d8401b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:54.530715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954d6fd-c936-4b9c-bd1c-8e78baffab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:54.531432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc39fd5-0f0e-45f9-a86e-ceb6c653743b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:54.531632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954d6fd-c936-4b9c-bd1c-8e78baffab1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:54.531759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc39fd5-0f0e-45f9-a86e-ceb6c653743b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:54.531912 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954d6fd-c936-4b9c-bd1c-8e78baffab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:54.532021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc39fd5-0f0e-45f9-a86e-ceb6c653743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:54.532185 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954d6fd-c936-4b9c-bd1c-8e78baffab1b admin admin] PATH_INFO: `/v3/projects/7f71da691c5c47e3902416d097da96e1/users/1e9bd2337e38411e93dd42b8bb1ac131/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:54.547539 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954d6fd-c936-4b9c-bd1c-8e78baffab1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f71da691c5c47e3902416d097da96e1, user_id=1e9bd2337e38411e93dd42b8bb1ac131, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:54.549176 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-2fc39fd5-0f0e-45f9-a86e-ceb6c653743b None None] MFA Rules not processed for user `e8a15e844eba4dd8864ff1fe152d9d63`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:54.550217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954d6fd-c936-4b9c-bd1c-8e78baffab1b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:54.550396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2fc39fd5-0f0e-45f9-a86e-ceb6c653743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:54.563182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1204/2418] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:42:54 2022] PUT /identity/v3/projects/7f71da691c5c47e3902416d097da96e1/users/1e9bd2337e38411e93dd42b8bb1ac131/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:42:54.566893 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954d6fd-c936-4b9c-bd1c-8e78baffab1b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:54.605471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1215/2419] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:42:54.628582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954d6fd-c936-4b9c-bd1c-8e78baffab1b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:54.633945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37b8fb-aacb-4b7a-87f6-a57433fac9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:54.635002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37b8fb-aacb-4b7a-87f6-a57433fac9ab admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:54.635002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37b8fb-aacb-4b7a-87f6-a57433fac9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:54.635182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37b8fb-aacb-4b7a-87f6-a57433fac9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:54.635843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37b8fb-aacb-4b7a-87f6-a57433fac9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:54.638035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37b8fb-aacb-4b7a-87f6-a57433fac9ab admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:54.651450 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1205/2420] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:42:54.652669 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc39fd5-0f0e-45f9-a86e-ceb6c653743b None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:54.663415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc39fd5-0f0e-45f9-a86e-ceb6c653743b None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:54.668441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27730803-3a39-4859-8fa2-c9ef9c2c0e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:54.669317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27730803-3a39-4859-8fa2-c9ef9c2c0e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:54.669790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27730803-3a39-4859-8fa2-c9ef9c2c0e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:54.670067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27730803-3a39-4859-8fa2-c9ef9c2c0e57 admin admin] PATH_INFO: `/v3/projects/7f71da691c5c47e3902416d097da96e1/users/1e9bd2337e38411e93dd42b8bb1ac131/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:54.672088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27730803-3a39-4859-8fa2-c9ef9c2c0e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f71da691c5c47e3902416d097da96e1, user_id=1e9bd2337e38411e93dd42b8bb1ac131, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:54.674715 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27730803-3a39-4859-8fa2-c9ef9c2c0e57 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:54.687789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1216/2421] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:42:54 2022] PUT /identity/v3/projects/7f71da691c5c47e3902416d097da96e1/users/1e9bd2337e38411e93dd42b8bb1ac131/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:54.698694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a168-9cb7-49b4-81a2-54c72bdc42ab None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:54.699683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a168-9cb7-49b4-81a2-54c72bdc42ab None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:54.700093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a168-9cb7-49b4-81a2-54c72bdc42ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:54.739057 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-1b97a168-9cb7-49b4-81a2-54c72bdc42ab None None] MFA Rules not processed for user `1e9bd2337e38411e93dd42b8bb1ac131`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:54.740423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-1b97a168-9cb7-49b4-81a2-54c72bdc42ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:54.826523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1206/2422] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:42:54.837732 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27730803-3a39-4859-8fa2-c9ef9c2c0e57 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:54.839496 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-27730803-3a39-4859-8fa2-c9ef9c2c0e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:54.897039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27730803-3a39-4859-8fa2-c9ef9c2c0e57 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:54.900745 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a524ae4-979b-4b62-9e9f-1252e12c02a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:54.901514 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a524ae4-979b-4b62-9e9f-1252e12c02a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:54.901910 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a524ae4-979b-4b62-9e9f-1252e12c02a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:54.902325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a524ae4-979b-4b62-9e9f-1252e12c02a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:54.911654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a524ae4-979b-4b62-9e9f-1252e12c02a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:54.913101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a524ae4-979b-4b62-9e9f-1252e12c02a9 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:54.922935 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1217/2423] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:42:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:42:55.494627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97a168-9cb7-49b4-81a2-54c72bdc42ab None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:55.560103 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97a168-9cb7-49b4-81a2-54c72bdc42ab None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:55.564795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:55.565669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:55.566491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:55.566766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] PATH_INFO: `/v3/users/4ca2de4fb1df4b42a2bf304982a24910` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:55.567985 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca2de4fb1df4b42a2bf304982a24910)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:55.569900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:55.634843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca2de4fb1df4b42a2bf304982a24910'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:55.635516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca2de4fb1df4b42a2bf304982a24910'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:55.648175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca2de4fb1df4b42a2bf304982a24910'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:55.656291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca2de4fb1df4b42a2bf304982a24910'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:55.663423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca2de4fb1df4b42a2bf304982a24910'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:55.670007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1207/2424] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:42:55 2022] DELETE /identity/v3/users/4ca2de4fb1df4b42a2bf304982a24910 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:55.674326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd98e-c091-4904-9870-b3b5256eaafc None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:55.674780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd98e-c091-4904-9870-b3b5256eaafc None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:55.674873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd98e-c091-4904-9870-b3b5256eaafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:55.692251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c71cd98e-c091-4904-9870-b3b5256eaafc None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:55.693963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c71cd98e-c091-4904-9870-b3b5256eaafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:55.755158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1218/2425] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:42:55.765553 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:55.767085 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:55.824827 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f64b4-a883-400c-a8cf-70edb29cc0cc admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:55.828485 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930963f4-e6b8-4d74-a5ff-db77d9498e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:55.829156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930963f4-e6b8-4d74-a5ff-db77d9498e1f service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:55.829435 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930963f4-e6b8-4d74-a5ff-db77d9498e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:55.829702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930963f4-e6b8-4d74-a5ff-db77d9498e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:55.839363 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930963f4-e6b8-4d74-a5ff-db77d9498e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:55.840815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930963f4-e6b8-4d74-a5ff-db77d9498e1f service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:55.851455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1208/2426] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:42:56.231148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cd98e-c091-4904-9870-b3b5256eaafc None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:56.233542 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c71cd98e-c091-4904-9870-b3b5256eaafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:56.251881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cd98e-c091-4904-9870-b3b5256eaafc None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:56.259579 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:56.260883 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:56.261296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:56.261707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] PATH_INFO: `/v3/projects/df17121a1d0f4704ab1b6d556e0cc95c` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:56.263042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df17121a1d0f4704ab1b6d556e0cc95c)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:56.265038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:56.327816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df17121a1d0f4704ab1b6d556e0cc95c', 'request_id': 'req-6349c338-55d2-4682-8ffe-6fa086541760'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:56.334265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df17121a1d0f4704ab1b6d556e0cc95c', 'request_id': 'req-6349c338-55d2-4682-8ffe-6fa086541760'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:56.341845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df17121a1d0f4704ab1b6d556e0cc95c', 'request_id': 'req-6349c338-55d2-4682-8ffe-6fa086541760'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:56.356762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] The token cache is being invalidate because project df17121a1d0f4704ab1b6d556e0cc95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:42:56.357055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:56.357778 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:56.359571 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1219/2427] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:42:56 2022] DELETE /identity/v3/projects/df17121a1d0f4704ab1b6d556e0cc95c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:56.363975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930963f4-e6b8-4d74-a5ff-db77d9498e1f service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:56.374095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930963f4-e6b8-4d74-a5ff-db77d9498e1f service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:56.416143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:56.418267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:56.446673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:56.448382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:56.448773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:56.449249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] PATH_INFO: `/v3/users/1e9bd2337e38411e93dd42b8bb1ac131` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:56.450770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9bd2337e38411e93dd42b8bb1ac131)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:56.452928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:56.488335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349c338-55d2-4682-8ffe-6fa086541760 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:56.492300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0d3b3-ee87-40e8-9db0-997a365e48a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:56.493327 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d3b3-ee87-40e8-9db0-997a365e48a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:56.493682 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d3b3-ee87-40e8-9db0-997a365e48a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:56.493960 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d3b3-ee87-40e8-9db0-997a365e48a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:56.496233 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-27b0d3b3-ee87-40e8-9db0-997a365e48a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:56.536518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9bd2337e38411e93dd42b8bb1ac131'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:56.537365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9bd2337e38411e93dd42b8bb1ac131'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:56.562242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9bd2337e38411e93dd42b8bb1ac131'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:56.576931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9bd2337e38411e93dd42b8bb1ac131'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:56.587187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9bd2337e38411e93dd42b8bb1ac131'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:56.596511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0d3b3-ee87-40e8-9db0-997a365e48a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:56.597988 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0d3b3-ee87-40e8-9db0-997a365e48a9 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:56.601425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1209/2428] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:42:56 2022] DELETE /identity/v3/users/1e9bd2337e38411e93dd42b8bb1ac131 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:56.612693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1220/2429] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:42:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:42:57.144016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:57.145537 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:57.213821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d0e09-1e59-411d-93e9-0cdf862af790 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:57.219192 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:57.220446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:57.220930 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:57.221703 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] PATH_INFO: `/v3/projects/7f71da691c5c47e3902416d097da96e1` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:57.223616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f71da691c5c47e3902416d097da96e1)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:57.225457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:57.271651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f71da691c5c47e3902416d097da96e1', 'request_id': 'req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:57.277439 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f71da691c5c47e3902416d097da96e1', 'request_id': 'req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:57.283779 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f71da691c5c47e3902416d097da96e1', 'request_id': 'req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:57.296829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] The token cache is being invalidate because project 7f71da691c5c47e3902416d097da96e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:42:57.297257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:57.297974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8ac3c04c-d415-4f48-9779-4ac63a40fbb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:42:57.299526 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1210/2430] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:42:57 2022] DELETE /identity/v3/projects/7f71da691c5c47e3902416d097da96e1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:57.306125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9606f2-9dd1-42bc-b464-8fd5c6565769 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:57.306585 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9606f2-9dd1-42bc-b464-8fd5c6565769 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:57.306701 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9606f2-9dd1-42bc-b464-8fd5c6565769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:57.324703 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-ae9606f2-9dd1-42bc-b464-8fd5c6565769 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:57.325895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ae9606f2-9dd1-42bc-b464-8fd5c6565769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:57.387074 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1221/2431] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:42:57.394451 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc358b-5ac6-4b41-a242-44b91fba7a0e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:57.394733 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc358b-5ac6-4b41-a242-44b91fba7a0e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:57.395049 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc358b-5ac6-4b41-a242-44b91fba7a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:57.413285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-21cc358b-5ac6-4b41-a242-44b91fba7a0e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:57.414465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-21cc358b-5ac6-4b41-a242-44b91fba7a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:57.423051 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1211/2432] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:42:57.427205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9606f2-9dd1-42bc-b464-8fd5c6565769 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:57.436807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9606f2-9dd1-42bc-b464-8fd5c6565769 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:57.441911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4be85-2871-4f4d-afd5-a1259b6deda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:57.442561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4be85-2871-4f4d-afd5-a1259b6deda8 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:57.442849 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4be85-2871-4f4d-afd5-a1259b6deda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:57.443155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4be85-2871-4f4d-afd5-a1259b6deda8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:57.443902 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4be85-2871-4f4d-afd5-a1259b6deda8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:42:57.444214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4be85-2871-4f4d-afd5-a1259b6deda8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:57.445800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4be85-2871-4f4d-afd5-a1259b6deda8 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:57.459417 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1222/2433] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:42:57.463954 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc358b-5ac6-4b41-a242-44b91fba7a0e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:57.473694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc358b-5ac6-4b41-a242-44b91fba7a0e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:57.479167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b7a79-b58d-4323-86e8-a1f11e92dbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:57.479912 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b7a79-b58d-4323-86e8-a1f11e92dbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:57.480257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b7a79-b58d-4323-86e8-a1f11e92dbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:57.480601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b7a79-b58d-4323-86e8-a1f11e92dbc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:57.481296 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b7a79-b58d-4323-86e8-a1f11e92dbc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:57.483288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b7a79-b58d-4323-86e8-a1f11e92dbc6 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:57.513660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1212/2434] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:42:57 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:42:57.515503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4be85-2871-4f4d-afd5-a1259b6deda8 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:57.525224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4be85-2871-4f4d-afd5-a1259b6deda8 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:57.586770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbccd10-a19d-43a4-88ee-e2ddf4971007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:57.587759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbccd10-a19d-43a4-88ee-e2ddf4971007 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:57.588113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbccd10-a19d-43a4-88ee-e2ddf4971007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:57.588501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbccd10-a19d-43a4-88ee-e2ddf4971007 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:57.590245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbccd10-a19d-43a4-88ee-e2ddf4971007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:57.592022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbccd10-a19d-43a4-88ee-e2ddf4971007 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:57.619506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1223/2435] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:42:57 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:42:57.622423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b7a79-b58d-4323-86e8-a1f11e92dbc6 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:57.635633 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b7a79-b58d-4323-86e8-a1f11e92dbc6 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:57.640905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a6182-6d6d-405d-a668-a359c9956c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:57.641634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a6182-6d6d-405d-a668-a359c9956c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:57.641983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a6182-6d6d-405d-a668-a359c9956c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:57.642321 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a6182-6d6d-405d-a668-a359c9956c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:57.643164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a6182-6d6d-405d-a668-a359c9956c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:57.644815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a6182-6d6d-405d-a668-a359c9956c4d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:57.656379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1213/2436] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:42:57.660362 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbccd10-a19d-43a4-88ee-e2ddf4971007 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:57.671178 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbccd10-a19d-43a4-88ee-e2ddf4971007 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:57.676850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeae1d3-847b-491c-bcae-9d9871b13057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:57.677583 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeae1d3-847b-491c-bcae-9d9871b13057 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:57.677963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeae1d3-847b-491c-bcae-9d9871b13057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:57.678304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeae1d3-847b-491c-bcae-9d9871b13057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:57.679125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeae1d3-847b-491c-bcae-9d9871b13057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:57.680786 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeae1d3-847b-491c-bcae-9d9871b13057 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:57.691719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1224/2437] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:42:57.696353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a6182-6d6d-405d-a668-a359c9956c4d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:57.708229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a6182-6d6d-405d-a668-a359c9956c4d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:57.713394 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696438dd-a974-44df-9645-a1fd8419b77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:57.714410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696438dd-a974-44df-9645-a1fd8419b77a admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:57.715264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696438dd-a974-44df-9645-a1fd8419b77a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:57.715623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696438dd-a974-44df-9645-a1fd8419b77a admin admin] PATH_INFO: `/v3/projects/32ec6fa2d34d47b4ad34d7b64f74cbbb/users/26b4bc596c0e4e1097311492a42433b4/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:57.730872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696438dd-a974-44df-9645-a1fd8419b77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ec6fa2d34d47b4ad34d7b64f74cbbb, user_id=26b4bc596c0e4e1097311492a42433b4, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:57.733567 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696438dd-a974-44df-9645-a1fd8419b77a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:57.748258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1214/2438] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:42:57 2022] PUT /identity/v3/projects/32ec6fa2d34d47b4ad34d7b64f74cbbb/users/26b4bc596c0e4e1097311492a42433b4/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:57.753299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba5b2c-f306-4e08-84e7-180889dd3950 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:57.753592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba5b2c-f306-4e08-84e7-180889dd3950 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:57.753871 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba5b2c-f306-4e08-84e7-180889dd3950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:57.774240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-66ba5b2c-f306-4e08-84e7-180889dd3950 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:57.775605 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-66ba5b2c-f306-4e08-84e7-180889dd3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:57.882966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1225/2439] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:42:57.901475 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696438dd-a974-44df-9645-a1fd8419b77a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:57.903373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-696438dd-a974-44df-9645-a1fd8419b77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:57.992528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696438dd-a974-44df-9645-a1fd8419b77a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:58.005944 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed9e4d-749c-4450-aa9f-1883b9ed5c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:58.006753 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed9e4d-749c-4450-aa9f-1883b9ed5c07 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:58.007431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed9e4d-749c-4450-aa9f-1883b9ed5c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:58.007966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed9e4d-749c-4450-aa9f-1883b9ed5c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:58.018868 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed9e4d-749c-4450-aa9f-1883b9ed5c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:58.020456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed9e4d-749c-4450-aa9f-1883b9ed5c07 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:58.032117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1215/2440] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:42:59.526556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051dd8a-4384-4b1b-bd81-1d41e7bc7e0d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:59.527964 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051dd8a-4384-4b1b-bd81-1d41e7bc7e0d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:59.528792 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051dd8a-4384-4b1b-bd81-1d41e7bc7e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:59.558559 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-3051dd8a-4384-4b1b-bd81-1d41e7bc7e0d None None] MFA Rules not processed for user `26b4bc596c0e4e1097311492a42433b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:42:59.560063 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3051dd8a-4384-4b1b-bd81-1d41e7bc7e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:59.629028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1226/2441] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:42:59.633375 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed9e4d-749c-4450-aa9f-1883b9ed5c07 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:59.644207 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed9e4d-749c-4450-aa9f-1883b9ed5c07 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:59.649158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173709a-6111-4069-b958-abd289d652eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:59.650656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173709a-6111-4069-b958-abd289d652eb admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:59.651247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173709a-6111-4069-b958-abd289d652eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:59.652246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173709a-6111-4069-b958-abd289d652eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:59.654070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173709a-6111-4069-b958-abd289d652eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:59.656419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173709a-6111-4069-b958-abd289d652eb admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:59.691756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1216/2442] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:42:59 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:42:59.695619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051dd8a-4384-4b1b-bd81-1d41e7bc7e0d None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:59.709344 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051dd8a-4384-4b1b-bd81-1d41e7bc7e0d None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:59.792995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e773a-2d3a-40a6-b24e-88dbb5948230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:59.793781 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e773a-2d3a-40a6-b24e-88dbb5948230 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:59.794170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e773a-2d3a-40a6-b24e-88dbb5948230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:59.794552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e773a-2d3a-40a6-b24e-88dbb5948230 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:59.795407 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e773a-2d3a-40a6-b24e-88dbb5948230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:59.797473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e773a-2d3a-40a6-b24e-88dbb5948230 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:59.824299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1227/2443] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:42:59 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:42:59.825700 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173709a-6111-4069-b958-abd289d652eb admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:59.836847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173709a-6111-4069-b958-abd289d652eb admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:59.842502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c83a29-39b7-4a1d-a25f-c0bdbcf30be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:59.843314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c83a29-39b7-4a1d-a25f-c0bdbcf30be8 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:59.843861 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c83a29-39b7-4a1d-a25f-c0bdbcf30be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:59.844214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c83a29-39b7-4a1d-a25f-c0bdbcf30be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:59.845024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c83a29-39b7-4a1d-a25f-c0bdbcf30be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:59.846862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c83a29-39b7-4a1d-a25f-c0bdbcf30be8 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:59.858595 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1217/2444] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:42:59.863308 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e773a-2d3a-40a6-b24e-88dbb5948230 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:59.876696 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e773a-2d3a-40a6-b24e-88dbb5948230 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:59.882476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1decfa-1a30-42ce-8af6-33f074f72ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:59.883394 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1decfa-1a30-42ce-8af6-33f074f72ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:59.883678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1decfa-1a30-42ce-8af6-33f074f72ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:59.883954 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1decfa-1a30-42ce-8af6-33f074f72ca5 admin admin] PATH_INFO: `/v3/projects/1ca020b2083c408391d61908a578da51/users/f9d584577487447aa20ced77ac8d0406/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:59.906518 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1decfa-1a30-42ce-8af6-33f074f72ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca020b2083c408391d61908a578da51, user_id=f9d584577487447aa20ced77ac8d0406, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:59.909471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1decfa-1a30-42ce-8af6-33f074f72ca5 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:59.924865 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1228/2445] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:42:59 2022] PUT /identity/v3/projects/1ca020b2083c408391d61908a578da51/users/f9d584577487447aa20ced77ac8d0406/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:42:59.928904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c83a29-39b7-4a1d-a25f-c0bdbcf30be8 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:59.939349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c83a29-39b7-4a1d-a25f-c0bdbcf30be8 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:59.997123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd69e28-4aff-4a96-a587-9075c1161195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:59.997888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd69e28-4aff-4a96-a587-9075c1161195 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:59.998167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd69e28-4aff-4a96-a587-9075c1161195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:59.998472 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd69e28-4aff-4a96-a587-9075c1161195 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:59.999229 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd69e28-4aff-4a96-a587-9075c1161195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:00.000831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd69e28-4aff-4a96-a587-9075c1161195 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:00.011793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1218/2446] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:00.016047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1decfa-1a30-42ce-8af6-33f074f72ca5 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:00.026150 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1decfa-1a30-42ce-8af6-33f074f72ca5 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:00.031582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5f117-5e07-4235-a335-d16c63e5687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:00.032464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f117-5e07-4235-a335-d16c63e5687b admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:00.032747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f117-5e07-4235-a335-d16c63e5687b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:00.033023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f117-5e07-4235-a335-d16c63e5687b admin admin] PATH_INFO: `/v3/projects/1ca020b2083c408391d61908a578da51/users/f9d584577487447aa20ced77ac8d0406/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:00.035175 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5f117-5e07-4235-a335-d16c63e5687b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca020b2083c408391d61908a578da51, user_id=f9d584577487447aa20ced77ac8d0406, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:00.037879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5f117-5e07-4235-a335-d16c63e5687b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:00.048360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1229/2447] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:00 2022] PUT /identity/v3/projects/1ca020b2083c408391d61908a578da51/users/f9d584577487447aa20ced77ac8d0406/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:00.734630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd69e28-4aff-4a96-a587-9075c1161195 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:00.736447 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-4fd69e28-4aff-4a96-a587-9075c1161195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:00.761807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5f117-5e07-4235-a335-d16c63e5687b admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:00.765453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5ed5f117-5e07-4235-a335-d16c63e5687b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:00.809973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd69e28-4aff-4a96-a587-9075c1161195 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:00.876728 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac1036-dfdf-4dc1-abb3-da9c993c34fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:00.877864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1036-dfdf-4dc1-abb3-da9c993c34fe service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:00.878845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1036-dfdf-4dc1-abb3-da9c993c34fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:00.879378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1036-dfdf-4dc1-abb3-da9c993c34fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:00.880560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5f117-5e07-4235-a335-d16c63e5687b admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:00.883196 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3aac1036-dfdf-4dc1-abb3-da9c993c34fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:00.884643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f5e8-654b-42be-9370-a3ac44a71f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:00.885812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f5e8-654b-42be-9370-a3ac44a71f04 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:00.886973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f5e8-654b-42be-9370-a3ac44a71f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:00.887249 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f5e8-654b-42be-9370-a3ac44a71f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:00.889179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c0f8f5e8-654b-42be-9370-a3ac44a71f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:00.981981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac1036-dfdf-4dc1-abb3-da9c993c34fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:00.983552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac1036-dfdf-4dc1-abb3-da9c993c34fe service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:00.995190 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1219/2448] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:00.995822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8f5e8-654b-42be-9370-a3ac44a71f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:00.997586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8f5e8-654b-42be-9370-a3ac44a71f04 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:01.006516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78620-3742-4bdf-8caa-258b48b94954 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:01.006791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78620-3742-4bdf-8caa-258b48b94954 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:01.011565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1230/2449] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:01.012132 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78620-3742-4bdf-8caa-258b48b94954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:01.060313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a0a78620-3742-4bdf-8caa-258b48b94954 None None] MFA Rules not processed for user `f9d584577487447aa20ced77ac8d0406`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:01.061563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a0a78620-3742-4bdf-8caa-258b48b94954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:01.147826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1220/2450] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:01.158789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f5e8-654b-42be-9370-a3ac44a71f04 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:01.160256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c0f8f5e8-654b-42be-9370-a3ac44a71f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:01.218276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f5e8-654b-42be-9370-a3ac44a71f04 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:01.221872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f30ae-3af1-4e40-b561-7d22bc8e46b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:01.222512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f30ae-3af1-4e40-b561-7d22bc8e46b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:01.222792 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f30ae-3af1-4e40-b561-7d22bc8e46b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:01.223097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f30ae-3af1-4e40-b561-7d22bc8e46b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:01.278482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f30ae-3af1-4e40-b561-7d22bc8e46b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:01.279975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f30ae-3af1-4e40-b561-7d22bc8e46b9 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:01.288832 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1231/2451] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:04.749826 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a78620-3742-4bdf-8caa-258b48b94954 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:04.759517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a78620-3742-4bdf-8caa-258b48b94954 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:04.763263 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767fef3-f1b9-4179-bfd5-fbdcca670109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:04.763719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767fef3-f1b9-4179-bfd5-fbdcca670109 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:04.764000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767fef3-f1b9-4179-bfd5-fbdcca670109 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:04.764274 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767fef3-f1b9-4179-bfd5-fbdcca670109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:04.773297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767fef3-f1b9-4179-bfd5-fbdcca670109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:04.774736 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767fef3-f1b9-4179-bfd5-fbdcca670109 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:04.784802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1221/2452] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:08.319445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f30ae-3af1-4e40-b561-7d22bc8e46b9 service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:08.320875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-938f30ae-3af1-4e40-b561-7d22bc8e46b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:08.336738 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f30ae-3af1-4e40-b561-7d22bc8e46b9 service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:08.342628 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66263-1782-401c-b851-20362af44959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:08.343312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66263-1782-401c-b851-20362af44959 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:08.343600 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66263-1782-401c-b851-20362af44959 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:08.343872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66263-1782-401c-b851-20362af44959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:08.345738 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-deb66263-1782-401c-b851-20362af44959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:08.404555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb66263-1782-401c-b851-20362af44959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:08.406210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb66263-1782-401c-b851-20362af44959 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:08.415494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1232/2453] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:09.479023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767fef3-f1b9-4179-bfd5-fbdcca670109 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:09.480414 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-1767fef3-f1b9-4179-bfd5-fbdcca670109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:09.495760 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767fef3-f1b9-4179-bfd5-fbdcca670109 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:09.501233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded30b5-1c86-4d32-b799-bfb34a70f891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:09.501854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded30b5-1c86-4d32-b799-bfb34a70f891 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:09.502132 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded30b5-1c86-4d32-b799-bfb34a70f891 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:09.502406 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded30b5-1c86-4d32-b799-bfb34a70f891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:09.504094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0ded30b5-1c86-4d32-b799-bfb34a70f891 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:09.559949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded30b5-1c86-4d32-b799-bfb34a70f891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:09.561518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded30b5-1c86-4d32-b799-bfb34a70f891 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:09.570309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1222/2454] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:12.074769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66263-1782-401c-b851-20362af44959 service nova] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:12.090575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66263-1782-401c-b851-20362af44959 service nova] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:12.094592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c50b9-521a-499f-b1b2-9d760a4dc9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:12.095281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c50b9-521a-499f-b1b2-9d760a4dc9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:12.095559 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c50b9-521a-499f-b1b2-9d760a4dc9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:12.095834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c50b9-521a-499f-b1b2-9d760a4dc9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:12.097634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-845c50b9-521a-499f-b1b2-9d760a4dc9b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:12.161268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c50b9-521a-499f-b1b2-9d760a4dc9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:12.162713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c50b9-521a-499f-b1b2-9d760a4dc9b1 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:12.173428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1233/2455] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:15.350521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded30b5-1c86-4d32-b799-bfb34a70f891 service nova] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:15.352130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0ded30b5-1c86-4d32-b799-bfb34a70f891 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:15.366447 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded30b5-1c86-4d32-b799-bfb34a70f891 service nova] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:15.372025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cdb11-6ddf-420d-aafc-66d948070a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:15.372911 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cdb11-6ddf-420d-aafc-66d948070a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:15.373191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cdb11-6ddf-420d-aafc-66d948070a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:15.373467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cdb11-6ddf-420d-aafc-66d948070a24 admin admin] PATH_INFO: `/v3/users/4d553b919f944c7a80ec345da995fbc5` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:15.374791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cdb11-6ddf-420d-aafc-66d948070a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d553b919f944c7a80ec345da995fbc5)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:15.376802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cdb11-6ddf-420d-aafc-66d948070a24 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:15.431865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ca3cdb11-6ddf-420d-aafc-66d948070a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d553b919f944c7a80ec345da995fbc5'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:15.433972 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ca3cdb11-6ddf-420d-aafc-66d948070a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d553b919f944c7a80ec345da995fbc5'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:15.448337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ca3cdb11-6ddf-420d-aafc-66d948070a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d553b919f944c7a80ec345da995fbc5'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:15.457474 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ca3cdb11-6ddf-420d-aafc-66d948070a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d553b919f944c7a80ec345da995fbc5'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:15.465476 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-ca3cdb11-6ddf-420d-aafc-66d948070a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d553b919f944c7a80ec345da995fbc5'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:15.472239 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1223/2456] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:15 2022] DELETE /identity/v3/users/4d553b919f944c7a80ec345da995fbc5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:15.684458 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c50b9-521a-499f-b1b2-9d760a4dc9b1 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:15.696052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c50b9-521a-499f-b1b2-9d760a4dc9b1 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:15.764451 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:15.765303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:15.765583 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:15.765850 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] PATH_INFO: `/v3/projects/61d81f9de04c480389701ad30319c05a` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:15.767058 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d81f9de04c480389701ad30319c05a)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:15.768953 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:15.819015 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d81f9de04c480389701ad30319c05a', 'request_id': 'req-26428bf5-33a2-424d-9754-12d002599a98'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:15.824321 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d81f9de04c480389701ad30319c05a', 'request_id': 'req-26428bf5-33a2-424d-9754-12d002599a98'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:15.830354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d81f9de04c480389701ad30319c05a', 'request_id': 'req-26428bf5-33a2-424d-9754-12d002599a98'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:15.843758 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] The token cache is being invalidate because project 61d81f9de04c480389701ad30319c05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:15.844047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:15.844686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-26428bf5-33a2-424d-9754-12d002599a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:15.846246 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1234/2457] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:15 2022] DELETE /identity/v3/projects/61d81f9de04c480389701ad30319c05a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:15.851144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68c8c-e14f-44f1-9771-0a0a49e6f3a6 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:15.851499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68c8c-e14f-44f1-9771-0a0a49e6f3a6 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:15.851854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68c8c-e14f-44f1-9771-0a0a49e6f3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:15.869782 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-d7a68c8c-e14f-44f1-9771-0a0a49e6f3a6 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:15.871034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d7a68c8c-e14f-44f1-9771-0a0a49e6f3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:15.928123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1224/2458] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:15.935985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3391149-4dfb-41fe-9afc-1342274c5525 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:15.936221 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3391149-4dfb-41fe-9afc-1342274c5525 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:15.936500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3391149-4dfb-41fe-9afc-1342274c5525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:15.954372 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-b3391149-4dfb-41fe-9afc-1342274c5525 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:15.955609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-b3391149-4dfb-41fe-9afc-1342274c5525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:15.964098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1235/2459] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:15.968257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a68c8c-e14f-44f1-9771-0a0a49e6f3a6 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:15.978134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a68c8c-e14f-44f1-9771-0a0a49e6f3a6 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:15.983556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46c3b-f51b-408f-9375-c308709828ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:15.984206 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46c3b-f51b-408f-9375-c308709828ad admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:15.984480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46c3b-f51b-408f-9375-c308709828ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:15.984746 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46c3b-f51b-408f-9375-c308709828ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:15.985455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb46c3b-f51b-408f-9375-c308709828ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:43:15.985752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb46c3b-f51b-408f-9375-c308709828ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:15.987394 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb46c3b-f51b-408f-9375-c308709828ad admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:16.002135 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1225/2460] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:43:16.003533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3391149-4dfb-41fe-9afc-1342274c5525 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:16.013007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3391149-4dfb-41fe-9afc-1342274c5525 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:16.017675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bd423-8bc3-41f0-a139-c749aa660677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:16.018258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd423-8bc3-41f0-a139-c749aa660677 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:16.018534 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd423-8bc3-41f0-a139-c749aa660677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:16.018810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd423-8bc3-41f0-a139-c749aa660677 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:16.019524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bd423-8bc3-41f0-a139-c749aa660677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:16.021389 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bd423-8bc3-41f0-a139-c749aa660677 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:16.047666 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1236/2461] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:16 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:16.051765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46c3b-f51b-408f-9375-c308709828ad admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:16.061513 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46c3b-f51b-408f-9375-c308709828ad admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:16.121719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e256454-ed7b-4a44-bee2-ff3ddbeb51bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:16.122396 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e256454-ed7b-4a44-bee2-ff3ddbeb51bd admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:16.122683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e256454-ed7b-4a44-bee2-ff3ddbeb51bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:16.122990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e256454-ed7b-4a44-bee2-ff3ddbeb51bd admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:16.123696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e256454-ed7b-4a44-bee2-ff3ddbeb51bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:16.125611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e256454-ed7b-4a44-bee2-ff3ddbeb51bd admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:16.147060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1226/2462] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:16 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:43:16.151967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bd423-8bc3-41f0-a139-c749aa660677 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:16.162212 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bd423-8bc3-41f0-a139-c749aa660677 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:16.166842 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef80e8c-a69f-412e-a152-2afd66ef9930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:16.167534 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80e8c-a69f-412e-a152-2afd66ef9930 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:16.167820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80e8c-a69f-412e-a152-2afd66ef9930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:16.168103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80e8c-a69f-412e-a152-2afd66ef9930 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:16.168821 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef80e8c-a69f-412e-a152-2afd66ef9930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:16.170446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef80e8c-a69f-412e-a152-2afd66ef9930 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:16.181056 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1237/2463] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:43:16.185224 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e256454-ed7b-4a44-bee2-ff3ddbeb51bd admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:16.195143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e256454-ed7b-4a44-bee2-ff3ddbeb51bd admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:16.200453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69a0ac-0397-42c8-9ec0-30764c75f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:16.201362 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69a0ac-0397-42c8-9ec0-30764c75f72b admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:16.201641 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69a0ac-0397-42c8-9ec0-30764c75f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:16.201945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69a0ac-0397-42c8-9ec0-30764c75f72b admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:16.202807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69a0ac-0397-42c8-9ec0-30764c75f72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:16.204616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69a0ac-0397-42c8-9ec0-30764c75f72b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:16.218153 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1227/2464] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:16.219526 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef80e8c-a69f-412e-a152-2afd66ef9930 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:16.229619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef80e8c-a69f-412e-a152-2afd66ef9930 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:16.234294 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b916d-987a-4d8b-b9f8-b0b0063c6ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:16.235228 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b916d-987a-4d8b-b9f8-b0b0063c6ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:16.235510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b916d-987a-4d8b-b9f8-b0b0063c6ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:16.235782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b916d-987a-4d8b-b9f8-b0b0063c6ae7 admin admin] PATH_INFO: `/v3/projects/e570e47c2f6740309c8eef5f9565bd14/users/0ea9f29684f34855b71f66bf91a3c2d3/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:16.250471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b916d-987a-4d8b-b9f8-b0b0063c6ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e570e47c2f6740309c8eef5f9565bd14, user_id=0ea9f29684f34855b71f66bf91a3c2d3, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:16.253141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b916d-987a-4d8b-b9f8-b0b0063c6ae7 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:16.267183 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1238/2465] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:16 2022] PUT /identity/v3/projects/e570e47c2f6740309c8eef5f9565bd14/users/0ea9f29684f34855b71f66bf91a3c2d3/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:16.278401 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e423d0d-79f3-4fd9-bbc9-43e306010e00 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:16.278772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e423d0d-79f3-4fd9-bbc9-43e306010e00 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:16.279141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e423d0d-79f3-4fd9-bbc9-43e306010e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:16.306416 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-6e423d0d-79f3-4fd9-bbc9-43e306010e00 None None] MFA Rules not processed for user `0ea9f29684f34855b71f66bf91a3c2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:16.306677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6e423d0d-79f3-4fd9-bbc9-43e306010e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:16.368242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1228/2466] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:16.379263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b916d-987a-4d8b-b9f8-b0b0063c6ae7 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:16.381173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-419b916d-987a-4d8b-b9f8-b0b0063c6ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:16.451822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b916d-987a-4d8b-b9f8-b0b0063c6ae7 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:16.457234 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bd884-f8b4-4c6a-92cf-60cad787c0ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:16.457859 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bd884-f8b4-4c6a-92cf-60cad787c0ed service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:16.458140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bd884-f8b4-4c6a-92cf-60cad787c0ed service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:16.458409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bd884-f8b4-4c6a-92cf-60cad787c0ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:16.466308 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bd884-f8b4-4c6a-92cf-60cad787c0ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:16.467906 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bd884-f8b4-4c6a-92cf-60cad787c0ed service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:16.476322 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1239/2467] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:16.656616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e423d0d-79f3-4fd9-bbc9-43e306010e00 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:16.721712 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e423d0d-79f3-4fd9-bbc9-43e306010e00 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:16.726332 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:16.727311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:16.727658 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:16.727993 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] PATH_INFO: `/v3/users/0ea9f29684f34855b71f66bf91a3c2d3` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:16.729247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea9f29684f34855b71f66bf91a3c2d3)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:16.731295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:16.781780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea9f29684f34855b71f66bf91a3c2d3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:16.782672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea9f29684f34855b71f66bf91a3c2d3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:16.799252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea9f29684f34855b71f66bf91a3c2d3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:16.812284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea9f29684f34855b71f66bf91a3c2d3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:16.819722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea9f29684f34855b71f66bf91a3c2d3'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:16.826292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1229/2468] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:16 2022] DELETE /identity/v3/users/0ea9f29684f34855b71f66bf91a3c2d3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:16.831169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08ceef-83f3-4220-b059-0302e5836974 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:16.831663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08ceef-83f3-4220-b059-0302e5836974 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:16.831851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08ceef-83f3-4220-b059-0302e5836974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:16.865377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-cb08ceef-83f3-4220-b059-0302e5836974 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:16.866590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cb08ceef-83f3-4220-b059-0302e5836974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:16.961621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1240/2469] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:16.972501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:16.974142 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:17.035279 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ae065-235c-466b-9ed1-e5beed9fe3c9 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:17.038834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ec59e-f91b-455d-8957-f38c3150555d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:17.039503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ec59e-f91b-455d-8957-f38c3150555d service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:17.039782 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ec59e-f91b-455d-8957-f38c3150555d service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:17.040056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ec59e-f91b-455d-8957-f38c3150555d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:17.049776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ec59e-f91b-455d-8957-f38c3150555d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:17.051248 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ec59e-f91b-455d-8957-f38c3150555d service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:17.061568 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1230/2470] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:17.337307 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08ceef-83f3-4220-b059-0302e5836974 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:17.338763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cb08ceef-83f3-4220-b059-0302e5836974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:17.351111 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08ceef-83f3-4220-b059-0302e5836974 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:17.355814 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:17.357020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:17.357386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:17.357761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] PATH_INFO: `/v3/projects/e570e47c2f6740309c8eef5f9565bd14` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:17.359110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e570e47c2f6740309c8eef5f9565bd14)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:17.361161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:17.411573 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e570e47c2f6740309c8eef5f9565bd14', 'request_id': 'req-62495295-9924-480f-b76a-c49b5f87d37e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:17.417097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e570e47c2f6740309c8eef5f9565bd14', 'request_id': 'req-62495295-9924-480f-b76a-c49b5f87d37e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:17.424145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e570e47c2f6740309c8eef5f9565bd14', 'request_id': 'req-62495295-9924-480f-b76a-c49b5f87d37e'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:17.436966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] The token cache is being invalidate because project e570e47c2f6740309c8eef5f9565bd14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:17.437261 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:17.437879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-62495295-9924-480f-b76a-c49b5f87d37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:17.439482 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1241/2471] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:17 2022] DELETE /identity/v3/projects/e570e47c2f6740309c8eef5f9565bd14 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:17.444311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de24b72-d36e-489c-9f5c-2537a5b93ee0 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:17.444816 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de24b72-d36e-489c-9f5c-2537a5b93ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:17.444915 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de24b72-d36e-489c-9f5c-2537a5b93ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:17.462723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-1de24b72-d36e-489c-9f5c-2537a5b93ee0 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:17.464004 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-1de24b72-d36e-489c-9f5c-2537a5b93ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:17.524204 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1231/2472] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:17.531673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70619d-4c1d-4280-b1e6-07eda662ae46 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:17.532033 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70619d-4c1d-4280-b1e6-07eda662ae46 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:17.532373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70619d-4c1d-4280-b1e6-07eda662ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:17.550768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-8d70619d-4c1d-4280-b1e6-07eda662ae46 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:17.552092 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8d70619d-4c1d-4280-b1e6-07eda662ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:17.560677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1242/2473] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:17.564851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de24b72-d36e-489c-9f5c-2537a5b93ee0 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:17.575145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de24b72-d36e-489c-9f5c-2537a5b93ee0 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:17.579736 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb9f0a-9d3b-400d-8f22-33f7be8c780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:17.580383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9f0a-9d3b-400d-8f22-33f7be8c780f admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:17.580662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9f0a-9d3b-400d-8f22-33f7be8c780f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:17.580933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9f0a-9d3b-400d-8f22-33f7be8c780f admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:17.581645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb9f0a-9d3b-400d-8f22-33f7be8c780f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:43:17.581957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb9f0a-9d3b-400d-8f22-33f7be8c780f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:17.583649 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb9f0a-9d3b-400d-8f22-33f7be8c780f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:17.595587 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1232/2474] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:43:17.599980 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70619d-4c1d-4280-b1e6-07eda662ae46 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:17.609228 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70619d-4c1d-4280-b1e6-07eda662ae46 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:17.614088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db917e-4013-4b16-a782-55de1f24a9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:17.614812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db917e-4013-4b16-a782-55de1f24a9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:17.615192 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db917e-4013-4b16-a782-55de1f24a9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:17.615532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db917e-4013-4b16-a782-55de1f24a9a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:17.616291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db917e-4013-4b16-a782-55de1f24a9a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:17.618189 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db917e-4013-4b16-a782-55de1f24a9a8 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:17.649553 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1243/2475] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:17 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:17.650722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb9f0a-9d3b-400d-8f22-33f7be8c780f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:17.660917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb9f0a-9d3b-400d-8f22-33f7be8c780f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:17.718420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6fe80-bd7a-474d-82de-45151bf36e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:17.719119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6fe80-bd7a-474d-82de-45151bf36e08 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:17.719395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6fe80-bd7a-474d-82de-45151bf36e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:17.719670 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6fe80-bd7a-474d-82de-45151bf36e08 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:17.720349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6fe80-bd7a-474d-82de-45151bf36e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:17.722288 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6fe80-bd7a-474d-82de-45151bf36e08 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:17.741334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1233/2476] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:17 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:43:17.746064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db917e-4013-4b16-a782-55de1f24a9a8 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:17.756590 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db917e-4013-4b16-a782-55de1f24a9a8 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:17.761467 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e965794-43cb-4057-b9ae-12b5ef141010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:17.762116 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e965794-43cb-4057-b9ae-12b5ef141010 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:17.762397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e965794-43cb-4057-b9ae-12b5ef141010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:17.762670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e965794-43cb-4057-b9ae-12b5ef141010 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:17.763420 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e965794-43cb-4057-b9ae-12b5ef141010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:17.765011 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e965794-43cb-4057-b9ae-12b5ef141010 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:17.775433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1244/2477] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:17.779284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6fe80-bd7a-474d-82de-45151bf36e08 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:17.788915 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6fe80-bd7a-474d-82de-45151bf36e08 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:17.794047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499944c-4775-4d61-af2c-317282b8e17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:17.794692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499944c-4775-4d61-af2c-317282b8e17d admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:17.795000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499944c-4775-4d61-af2c-317282b8e17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:17.795277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499944c-4775-4d61-af2c-317282b8e17d admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:17.795987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499944c-4775-4d61-af2c-317282b8e17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:17.797616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499944c-4775-4d61-af2c-317282b8e17d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:17.812025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1234/2478] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:17.813255 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e965794-43cb-4057-b9ae-12b5ef141010 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:17.823385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e965794-43cb-4057-b9ae-12b5ef141010 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:17.827963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ab12f-22f9-444d-bfa4-65ec7994b7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:17.828825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab12f-22f9-444d-bfa4-65ec7994b7de admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:17.829107 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab12f-22f9-444d-bfa4-65ec7994b7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:17.829380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab12f-22f9-444d-bfa4-65ec7994b7de admin admin] PATH_INFO: `/v3/projects/45d6caa33c4442578528e2d51739824d/users/f9de876828b945099cacd4ee9e3bf143/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:17.843966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ab12f-22f9-444d-bfa4-65ec7994b7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d6caa33c4442578528e2d51739824d, user_id=f9de876828b945099cacd4ee9e3bf143, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:17.846606 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ab12f-22f9-444d-bfa4-65ec7994b7de admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:17.860834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1245/2479] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:17 2022] PUT /identity/v3/projects/45d6caa33c4442578528e2d51739824d/users/f9de876828b945099cacd4ee9e3bf143/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:17.871906 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0a5d-469f-4123-8760-547fe9a24efb None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:17.872189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0a5d-469f-4123-8760-547fe9a24efb None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:17.872461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0a5d-469f-4123-8760-547fe9a24efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:17.899450 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-5f2a0a5d-469f-4123-8760-547fe9a24efb None None] MFA Rules not processed for user `f9de876828b945099cacd4ee9e3bf143`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:17.900651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5f2a0a5d-469f-4123-8760-547fe9a24efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:17.968577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1235/2480] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:17.969619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ab12f-22f9-444d-bfa4-65ec7994b7de admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:18.038299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ab12f-22f9-444d-bfa4-65ec7994b7de admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:18.045247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c7611-8792-4aae-85b1-31f8310052fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:18.045986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c7611-8792-4aae-85b1-31f8310052fa admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:18.046335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c7611-8792-4aae-85b1-31f8310052fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:18.046676 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c7611-8792-4aae-85b1-31f8310052fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:18.047487 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c7611-8792-4aae-85b1-31f8310052fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:18.049458 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c7611-8792-4aae-85b1-31f8310052fa admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:18.084807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1246/2481] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:17 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:18.095612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a0a5d-469f-4123-8760-547fe9a24efb None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:18.107747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a0a5d-469f-4123-8760-547fe9a24efb None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:18.166597 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114fdae-044b-4c37-a574-9ae87e5c7b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:18.167920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114fdae-044b-4c37-a574-9ae87e5c7b24 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:18.168212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114fdae-044b-4c37-a574-9ae87e5c7b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:18.169131 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114fdae-044b-4c37-a574-9ae87e5c7b24 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:18.169843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114fdae-044b-4c37-a574-9ae87e5c7b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:18.180098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114fdae-044b-4c37-a574-9ae87e5c7b24 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:18.201281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1236/2482] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:18 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:18.205200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c7611-8792-4aae-85b1-31f8310052fa admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:18.216238 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c7611-8792-4aae-85b1-31f8310052fa admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:18.221753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f4b7b-3cdd-4bff-b5cd-8fc0ee00a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:18.222413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f4b7b-3cdd-4bff-b5cd-8fc0ee00a41b admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:18.222694 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f4b7b-3cdd-4bff-b5cd-8fc0ee00a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:18.222997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f4b7b-3cdd-4bff-b5cd-8fc0ee00a41b admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:18.223774 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f4b7b-3cdd-4bff-b5cd-8fc0ee00a41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:18.225363 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f4b7b-3cdd-4bff-b5cd-8fc0ee00a41b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:18.236822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1247/2483] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:18.240914 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114fdae-044b-4c37-a574-9ae87e5c7b24 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:18.250681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114fdae-044b-4c37-a574-9ae87e5c7b24 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:18.255599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb26f-e3c1-436d-870a-e74840d19beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:18.256469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb26f-e3c1-436d-870a-e74840d19beb admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:18.256744 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb26f-e3c1-436d-870a-e74840d19beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:18.257014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb26f-e3c1-436d-870a-e74840d19beb admin admin] PATH_INFO: `/v3/projects/8b201e7d5d12490ea7cee478428eb42c/users/38e8474479da4822af308bc5e80cd112/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:18.271874 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efb26f-e3c1-436d-870a-e74840d19beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b201e7d5d12490ea7cee478428eb42c, user_id=38e8474479da4822af308bc5e80cd112, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:18.274702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efb26f-e3c1-436d-870a-e74840d19beb admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:18.288803 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1237/2484] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:18 2022] PUT /identity/v3/projects/8b201e7d5d12490ea7cee478428eb42c/users/38e8474479da4822af308bc5e80cd112/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:18.293307 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f4b7b-3cdd-4bff-b5cd-8fc0ee00a41b admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:18.303210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f4b7b-3cdd-4bff-b5cd-8fc0ee00a41b admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:18.357315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0598d9-8e1e-4189-a187-47cd26a70930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:18.357968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0598d9-8e1e-4189-a187-47cd26a70930 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:18.358243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0598d9-8e1e-4189-a187-47cd26a70930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:18.358510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0598d9-8e1e-4189-a187-47cd26a70930 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:18.359260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0598d9-8e1e-4189-a187-47cd26a70930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:18.360835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0598d9-8e1e-4189-a187-47cd26a70930 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:18.370581 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1248/2485] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:18.374961 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb26f-e3c1-436d-870a-e74840d19beb admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:18.385134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb26f-e3c1-436d-870a-e74840d19beb admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:18.390310 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b8f35-2ea2-4d11-be29-1588f97f5121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:18.391254 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8f35-2ea2-4d11-be29-1588f97f5121 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:18.391537 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8f35-2ea2-4d11-be29-1588f97f5121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:18.391803 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8f35-2ea2-4d11-be29-1588f97f5121 admin admin] PATH_INFO: `/v3/projects/8b201e7d5d12490ea7cee478428eb42c/users/38e8474479da4822af308bc5e80cd112/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:18.393781 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b8f35-2ea2-4d11-be29-1588f97f5121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b201e7d5d12490ea7cee478428eb42c, user_id=38e8474479da4822af308bc5e80cd112, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:18.396444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b8f35-2ea2-4d11-be29-1588f97f5121 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:18.407486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1238/2486] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:18 2022] PUT /identity/v3/projects/8b201e7d5d12490ea7cee478428eb42c/users/38e8474479da4822af308bc5e80cd112/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:18.419022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a99ab-b8a7-473f-b378-a583b815fd96 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:18.419315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a99ab-b8a7-473f-b378-a583b815fd96 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:18.419646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a99ab-b8a7-473f-b378-a583b815fd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:18.447300 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-b50a99ab-b8a7-473f-b378-a583b815fd96 None None] MFA Rules not processed for user `38e8474479da4822af308bc5e80cd112`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:18.449032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-b50a99ab-b8a7-473f-b378-a583b815fd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:18.520315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1249/2487] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:18.531969 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b8f35-2ea2-4d11-be29-1588f97f5121 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:18.533716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3f7b8f35-2ea2-4d11-be29-1588f97f5121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:18.596178 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b8f35-2ea2-4d11-be29-1588f97f5121 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:18.600799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04c871-3d1d-4fae-bbe3-587dac1e5049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:18.601628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04c871-3d1d-4fae-bbe3-587dac1e5049 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:18.602006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04c871-3d1d-4fae-bbe3-587dac1e5049 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:18.602380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04c871-3d1d-4fae-bbe3-587dac1e5049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:18.613139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04c871-3d1d-4fae-bbe3-587dac1e5049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:18.614664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04c871-3d1d-4fae-bbe3-587dac1e5049 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:18.627290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1239/2488] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:18.710656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a99ab-b8a7-473f-b378-a583b815fd96 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:18.723787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a99ab-b8a7-473f-b378-a583b815fd96 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:18.731092 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d1367-1cc3-4bd0-a4a9-fcb39048c054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:18.733631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d1367-1cc3-4bd0-a4a9-fcb39048c054 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:18.734092 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d1367-1cc3-4bd0-a4a9-fcb39048c054 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:18.734373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d1367-1cc3-4bd0-a4a9-fcb39048c054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:18.816130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d1367-1cc3-4bd0-a4a9-fcb39048c054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:18.817656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d1367-1cc3-4bd0-a4a9-fcb39048c054 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:18.837503 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1250/2489] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:19.802291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04c871-3d1d-4fae-bbe3-587dac1e5049 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:19.803960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-dd04c871-3d1d-4fae-bbe3-587dac1e5049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:19.861577 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04c871-3d1d-4fae-bbe3-587dac1e5049 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:19.865212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f58e58-9788-47a5-8c48-5129d84c50d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:19.865855 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58e58-9788-47a5-8c48-5129d84c50d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:19.866138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58e58-9788-47a5-8c48-5129d84c50d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:19.866413 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58e58-9788-47a5-8c48-5129d84c50d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:19.868202 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-16f58e58-9788-47a5-8c48-5129d84c50d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:19.878531 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f58e58-9788-47a5-8c48-5129d84c50d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:19.880074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f58e58-9788-47a5-8c48-5129d84c50d1 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:19.889411 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1240/2490] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:21.718953 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d1367-1cc3-4bd0-a4a9-fcb39048c054 service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:21.783773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d1367-1cc3-4bd0-a4a9-fcb39048c054 service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:21.788709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:21.789609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:21.789883 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:21.790153 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] PATH_INFO: `/v3/users/f9de876828b945099cacd4ee9e3bf143` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:21.791390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9de876828b945099cacd4ee9e3bf143)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:21.793828 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:21.838434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9de876828b945099cacd4ee9e3bf143'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:21.839789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9de876828b945099cacd4ee9e3bf143'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:21.840387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9de876828b945099cacd4ee9e3bf143'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:21.851790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9de876828b945099cacd4ee9e3bf143'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:21.860801 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9de876828b945099cacd4ee9e3bf143'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:21.873271 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1251/2491] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:21 2022] DELETE /identity/v3/users/f9de876828b945099cacd4ee9e3bf143 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:21.877750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda31e38-f0b7-44a7-88b1-09bc0df19a06 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:21.878237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda31e38-f0b7-44a7-88b1-09bc0df19a06 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:21.878334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda31e38-f0b7-44a7-88b1-09bc0df19a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:21.895398 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-dda31e38-f0b7-44a7-88b1-09bc0df19a06 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:21.896563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-dda31e38-f0b7-44a7-88b1-09bc0df19a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:21.954722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1241/2492] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:21.965355 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:21.966658 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:22.024023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a12f0-4dce-4dc7-8684-c5ce5ef08921 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:22.028434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583c5f-1751-4391-b50f-7b064240244f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:22.029078 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583c5f-1751-4391-b50f-7b064240244f service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:22.029363 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583c5f-1751-4391-b50f-7b064240244f service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:22.029639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583c5f-1751-4391-b50f-7b064240244f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:22.038810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06583c5f-1751-4391-b50f-7b064240244f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:22.040267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06583c5f-1751-4391-b50f-7b064240244f service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:22.050364 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1252/2493] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:22.315575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda31e38-f0b7-44a7-88b1-09bc0df19a06 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:22.317054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-dda31e38-f0b7-44a7-88b1-09bc0df19a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:22.330126 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda31e38-f0b7-44a7-88b1-09bc0df19a06 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:22.334771 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:22.335664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:22.335945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:22.336216 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] PATH_INFO: `/v3/projects/45d6caa33c4442578528e2d51739824d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:22.337448 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d6caa33c4442578528e2d51739824d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:22.340025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:22.386665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d6caa33c4442578528e2d51739824d', 'request_id': 'req-2e6a894b-3ebb-4cd9-818a-bc5df4308507'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.391990 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d6caa33c4442578528e2d51739824d', 'request_id': 'req-2e6a894b-3ebb-4cd9-818a-bc5df4308507'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.398065 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d6caa33c4442578528e2d51739824d', 'request_id': 'req-2e6a894b-3ebb-4cd9-818a-bc5df4308507'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.410619 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] The token cache is being invalidate because project 45d6caa33c4442578528e2d51739824d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:22.410918 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.411548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.413061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1242/2494] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:22 2022] DELETE /identity/v3/projects/45d6caa33c4442578528e2d51739824d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:22.417023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583c5f-1751-4391-b50f-7b064240244f service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:22.426614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583c5f-1751-4391-b50f-7b064240244f service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:22.480459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f67d0d-5c00-4a01-a2f6-8d61e4e236fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:22.481238 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f67d0d-5c00-4a01-a2f6-8d61e4e236fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:22.481517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f67d0d-5c00-4a01-a2f6-8d61e4e236fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:22.481793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f67d0d-5c00-4a01-a2f6-8d61e4e236fd admin admin] PATH_INFO: `/v3/users/38e8474479da4822af308bc5e80cd112` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:22.483155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f67d0d-5c00-4a01-a2f6-8d61e4e236fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e8474479da4822af308bc5e80cd112)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:22.485073 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f67d0d-5c00-4a01-a2f6-8d61e4e236fd admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:22.529416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f1f67d0d-5c00-4a01-a2f6-8d61e4e236fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e8474479da4822af308bc5e80cd112'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.530088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f1f67d0d-5c00-4a01-a2f6-8d61e4e236fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e8474479da4822af308bc5e80cd112'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.530691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f1f67d0d-5c00-4a01-a2f6-8d61e4e236fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e8474479da4822af308bc5e80cd112'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.542031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f1f67d0d-5c00-4a01-a2f6-8d61e4e236fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e8474479da4822af308bc5e80cd112'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.548861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-f1f67d0d-5c00-4a01-a2f6-8d61e4e236fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e8474479da4822af308bc5e80cd112'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.561211 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1253/2495] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:22 2022] DELETE /identity/v3/users/38e8474479da4822af308bc5e80cd112 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:22.818185 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:22.819682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:22.835315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a894b-3ebb-4cd9-818a-bc5df4308507 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:22.891247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:22.892491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:22.892861 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:22.893238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] PATH_INFO: `/v3/projects/8b201e7d5d12490ea7cee478428eb42c` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:22.894549 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b201e7d5d12490ea7cee478428eb42c)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:22.896992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:22.941833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b201e7d5d12490ea7cee478428eb42c', 'request_id': 'req-157e12f3-32eb-4303-b6bc-3d02fbef2622'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.946866 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b201e7d5d12490ea7cee478428eb42c', 'request_id': 'req-157e12f3-32eb-4303-b6bc-3d02fbef2622'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.952638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b201e7d5d12490ea7cee478428eb42c', 'request_id': 'req-157e12f3-32eb-4303-b6bc-3d02fbef2622'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.964056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] The token cache is being invalidate because project 8b201e7d5d12490ea7cee478428eb42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:22.964338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.964941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-157e12f3-32eb-4303-b6bc-3d02fbef2622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:22.966424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1243/2496] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:22 2022] DELETE /identity/v3/projects/8b201e7d5d12490ea7cee478428eb42c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:22.971415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4afc4c-e296-47e8-8413-bb8b4c67c4e7 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:22.971925 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4afc4c-e296-47e8-8413-bb8b4c67c4e7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:22.972025 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4afc4c-e296-47e8-8413-bb8b4c67c4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:22.991239 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-0f4afc4c-e296-47e8-8413-bb8b4c67c4e7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:22.992449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0f4afc4c-e296-47e8-8413-bb8b4c67c4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:23.050098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1254/2497] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:23.058307 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f8fdf-a50a-4478-8409-3e7cd6868c85 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.058586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f8fdf-a50a-4478-8409-3e7cd6868c85 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.058852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f8fdf-a50a-4478-8409-3e7cd6868c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.076328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-956f8fdf-a50a-4478-8409-3e7cd6868c85 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:23.077502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-956f8fdf-a50a-4478-8409-3e7cd6868c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:23.086643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1244/2498] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:23.090860 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4afc4c-e296-47e8-8413-bb8b4c67c4e7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.100597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4afc4c-e296-47e8-8413-bb8b4c67c4e7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.105783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10182605-84c7-4ede-84d4-258d43374ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.106429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182605-84c7-4ede-84d4-258d43374ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.106711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182605-84c7-4ede-84d4-258d43374ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.107026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182605-84c7-4ede-84d4-258d43374ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.107934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10182605-84c7-4ede-84d4-258d43374ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:43:23.108240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10182605-84c7-4ede-84d4-258d43374ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.109923 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10182605-84c7-4ede-84d4-258d43374ca0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.121899 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1255/2499] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:43:23.126020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f8fdf-a50a-4478-8409-3e7cd6868c85 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.135185 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f8fdf-a50a-4478-8409-3e7cd6868c85 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.139776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f91423-4876-416c-a28d-7c3586a0dea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.140401 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f91423-4876-416c-a28d-7c3586a0dea0 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.140671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f91423-4876-416c-a28d-7c3586a0dea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.140937 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f91423-4876-416c-a28d-7c3586a0dea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.141607 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f91423-4876-416c-a28d-7c3586a0dea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.143571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f91423-4876-416c-a28d-7c3586a0dea0 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.167875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1245/2500] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:23 2022] POST /identity/v3/projects => generated 407 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:23.171841 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10182605-84c7-4ede-84d4-258d43374ca0 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.181687 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10182605-84c7-4ede-84d4-258d43374ca0 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.236180 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba122a-c667-4582-84cf-4eb60617fd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.236837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba122a-c667-4582-84cf-4eb60617fd00 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.237113 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba122a-c667-4582-84cf-4eb60617fd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.237385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba122a-c667-4582-84cf-4eb60617fd00 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.238277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba122a-c667-4582-84cf-4eb60617fd00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.240224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba122a-c667-4582-84cf-4eb60617fd00 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.267798 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1256/2501] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:23 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:23.267905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f91423-4876-416c-a28d-7c3586a0dea0 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.276814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f91423-4876-416c-a28d-7c3586a0dea0 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.281385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23bd17-d980-45fb-9d33-6d8411c10285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.282026 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23bd17-d980-45fb-9d33-6d8411c10285 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.282303 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23bd17-d980-45fb-9d33-6d8411c10285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.282573 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23bd17-d980-45fb-9d33-6d8411c10285 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.283315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23bd17-d980-45fb-9d33-6d8411c10285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.284889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23bd17-d980-45fb-9d33-6d8411c10285 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.295412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1246/2502] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:23.299143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba122a-c667-4582-84cf-4eb60617fd00 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.308712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba122a-c667-4582-84cf-4eb60617fd00 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.313181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94d332-06cd-44de-b1d0-a4f13bd7a8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.313816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94d332-06cd-44de-b1d0-a4f13bd7a8ee admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.314088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94d332-06cd-44de-b1d0-a4f13bd7a8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.314358 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94d332-06cd-44de-b1d0-a4f13bd7a8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.315097 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94d332-06cd-44de-b1d0-a4f13bd7a8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.316730 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94d332-06cd-44de-b1d0-a4f13bd7a8ee admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.327636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1257/2503] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:23.331632 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23bd17-d980-45fb-9d33-6d8411c10285 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.341621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23bd17-d980-45fb-9d33-6d8411c10285 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.346062 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058de61-6d37-4db5-8512-82a93f6bce39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.346933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058de61-6d37-4db5-8512-82a93f6bce39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.347212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058de61-6d37-4db5-8512-82a93f6bce39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.347480 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058de61-6d37-4db5-8512-82a93f6bce39 admin admin] PATH_INFO: `/v3/projects/4d3c263b67cd411bb4f67313b1db7cda/users/97b402faf653441f9680abbc08186a3b/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.362047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058de61-6d37-4db5-8512-82a93f6bce39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3c263b67cd411bb4f67313b1db7cda, user_id=97b402faf653441f9680abbc08186a3b, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.364692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058de61-6d37-4db5-8512-82a93f6bce39 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.377534 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1247/2504] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:23 2022] PUT /identity/v3/projects/4d3c263b67cd411bb4f67313b1db7cda/users/97b402faf653441f9680abbc08186a3b/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:23.387896 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf50e6-497b-4ece-9107-27de629af05f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.388182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf50e6-497b-4ece-9107-27de629af05f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.388458 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf50e6-497b-4ece-9107-27de629af05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.415279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-eabf50e6-497b-4ece-9107-27de629af05f None None] MFA Rules not processed for user `97b402faf653441f9680abbc08186a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:23.416475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-eabf50e6-497b-4ece-9107-27de629af05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:23.476523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1258/2505] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:23.481588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058de61-6d37-4db5-8512-82a93f6bce39 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.539737 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058de61-6d37-4db5-8512-82a93f6bce39 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.545002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e047b73-be82-4dc2-b9f6-214670cba532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.545682 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e047b73-be82-4dc2-b9f6-214670cba532 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.545965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e047b73-be82-4dc2-b9f6-214670cba532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.546238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e047b73-be82-4dc2-b9f6-214670cba532 admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.546947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e047b73-be82-4dc2-b9f6-214670cba532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.548844 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e047b73-be82-4dc2-b9f6-214670cba532 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.572460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1248/2506] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:23 2022] POST /identity/v3/projects => generated 409 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:23.576608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf50e6-497b-4ece-9107-27de629af05f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.587114 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf50e6-497b-4ece-9107-27de629af05f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.642305 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2170c-26a5-4925-9ce4-26243bb2e720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.642998 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2170c-26a5-4925-9ce4-26243bb2e720 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.643282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2170c-26a5-4925-9ce4-26243bb2e720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.643558 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2170c-26a5-4925-9ce4-26243bb2e720 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.644247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2170c-26a5-4925-9ce4-26243bb2e720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.646143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2170c-26a5-4925-9ce4-26243bb2e720 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.665578 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1259/2507] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:23 2022] POST /identity/v3/users => generated 311 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:23.669612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e047b73-be82-4dc2-b9f6-214670cba532 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.679906 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e047b73-be82-4dc2-b9f6-214670cba532 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.684611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b76c9-0c71-433b-b571-d96e648e382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.685408 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b76c9-0c71-433b-b571-d96e648e382a admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.685690 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b76c9-0c71-433b-b571-d96e648e382a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.685994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b76c9-0c71-433b-b571-d96e648e382a admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.686759 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b76c9-0c71-433b-b571-d96e648e382a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.688633 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b76c9-0c71-433b-b571-d96e648e382a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.700549 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1249/2508] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:23.704743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2170c-26a5-4925-9ce4-26243bb2e720 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.715215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2170c-26a5-4925-9ce4-26243bb2e720 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.719885 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9f22b-df88-42b0-a6b5-2d386d6b5a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.720747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9f22b-df88-42b0-a6b5-2d386d6b5a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.721020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9f22b-df88-42b0-a6b5-2d386d6b5a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.721299 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9f22b-df88-42b0-a6b5-2d386d6b5a21 admin admin] PATH_INFO: `/v3/projects/07f8289327664ae8bf843f125f94241d/users/ebb8d407eb6849f2b1854b428ad3ca1c/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.735635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9f22b-df88-42b0-a6b5-2d386d6b5a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f8289327664ae8bf843f125f94241d, user_id=ebb8d407eb6849f2b1854b428ad3ca1c, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.738393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9f22b-df88-42b0-a6b5-2d386d6b5a21 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.750591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1260/2509] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:23 2022] PUT /identity/v3/projects/07f8289327664ae8bf843f125f94241d/users/ebb8d407eb6849f2b1854b428ad3ca1c/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:23.754409 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b76c9-0c71-433b-b571-d96e648e382a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.764929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b76c9-0c71-433b-b571-d96e648e382a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.820283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b89673-1b0e-42d2-99c7-c650388bbd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.820943 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b89673-1b0e-42d2-99c7-c650388bbd23 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.821222 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b89673-1b0e-42d2-99c7-c650388bbd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.821496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b89673-1b0e-42d2-99c7-c650388bbd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.822217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b89673-1b0e-42d2-99c7-c650388bbd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.824562 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b89673-1b0e-42d2-99c7-c650388bbd23 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.834310 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1250/2510] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:23.839361 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9f22b-df88-42b0-a6b5-2d386d6b5a21 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.849495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9f22b-df88-42b0-a6b5-2d386d6b5a21 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:23.854123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e8de-7419-4b04-8381-1ee0e4c57ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:23.855023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e8de-7419-4b04-8381-1ee0e4c57ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.855302 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e8de-7419-4b04-8381-1ee0e4c57ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.855570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e8de-7419-4b04-8381-1ee0e4c57ab8 admin admin] PATH_INFO: `/v3/projects/07f8289327664ae8bf843f125f94241d/users/ebb8d407eb6849f2b1854b428ad3ca1c/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.857497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170e8de-7419-4b04-8381-1ee0e4c57ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f8289327664ae8bf843f125f94241d, user_id=ebb8d407eb6849f2b1854b428ad3ca1c, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:23.860290 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170e8de-7419-4b04-8381-1ee0e4c57ab8 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:23.870571 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1261/2511] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:23 2022] PUT /identity/v3/projects/07f8289327664ae8bf843f125f94241d/users/ebb8d407eb6849f2b1854b428ad3ca1c/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:23.881960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a696b-6464-4ca8-b500-cf23ef39a465 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:23.882267 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a696b-6464-4ca8-b500-cf23ef39a465 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:23.882523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a696b-6464-4ca8-b500-cf23ef39a465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:23.909036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-a01a696b-6464-4ca8-b500-cf23ef39a465 None None] MFA Rules not processed for user `ebb8d407eb6849f2b1854b428ad3ca1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:23.910223 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a01a696b-6464-4ca8-b500-cf23ef39a465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:23.975446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1251/2512] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:23 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:23.986046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e8de-7419-4b04-8381-1ee0e4c57ab8 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:23.987840 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e170e8de-7419-4b04-8381-1ee0e4c57ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:24.042363 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e8de-7419-4b04-8381-1ee0e4c57ab8 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:24.045950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1c630-fadb-4359-b6a5-1d490c70c285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:24.046570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c630-fadb-4359-b6a5-1d490c70c285 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:24.046847 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c630-fadb-4359-b6a5-1d490c70c285 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:24.047150 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c630-fadb-4359-b6a5-1d490c70c285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:24.055845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1c630-fadb-4359-b6a5-1d490c70c285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:24.057791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1c630-fadb-4359-b6a5-1d490c70c285 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:24.066844 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1262/2513] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:23 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:24.211611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a696b-6464-4ca8-b500-cf23ef39a465 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:24.221638 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a696b-6464-4ca8-b500-cf23ef39a465 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:24.225500 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c89d70-bf08-452b-93fd-5cf579ee3aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:24.226217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89d70-bf08-452b-93fd-5cf579ee3aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:24.226483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89d70-bf08-452b-93fd-5cf579ee3aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:24.226818 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89d70-bf08-452b-93fd-5cf579ee3aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:24.283276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c89d70-bf08-452b-93fd-5cf579ee3aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:24.284727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c89d70-bf08-452b-93fd-5cf579ee3aa2 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:24.294037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1252/2514] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:28.470697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1c630-fadb-4359-b6a5-1d490c70c285 service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:28.472155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d2b1c630-fadb-4359-b6a5-1d490c70c285 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:28.535728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1c630-fadb-4359-b6a5-1d490c70c285 service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:28.540542 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:28.541434 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:28.542208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:28.542478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] PATH_INFO: `/v3/users/26b4bc596c0e4e1097311492a42433b4` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:28.543711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b4bc596c0e4e1097311492a42433b4)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:28.545614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:28.588996 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b4bc596c0e4e1097311492a42433b4'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:28.589648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b4bc596c0e4e1097311492a42433b4'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:28.590250 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b4bc596c0e4e1097311492a42433b4'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:28.601722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b4bc596c0e4e1097311492a42433b4'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:28.609158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b4bc596c0e4e1097311492a42433b4'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:28.623977 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1263/2515] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:28 2022] DELETE /identity/v3/users/26b4bc596c0e4e1097311492a42433b4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:28.791199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c89d70-bf08-452b-93fd-5cf579ee3aa2 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:28.802400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c89d70-bf08-452b-93fd-5cf579ee3aa2 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:28.857036 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:28.857898 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:28.858175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:28.858446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] PATH_INFO: `/v3/projects/32ec6fa2d34d47b4ad34d7b64f74cbbb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:28.860125 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ec6fa2d34d47b4ad34d7b64f74cbbb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:28.861621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:28.911431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ec6fa2d34d47b4ad34d7b64f74cbbb', 'request_id': 'req-1fd3ab92-d13d-4679-9264-529c5a8d19f7'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:28.916647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ec6fa2d34d47b4ad34d7b64f74cbbb', 'request_id': 'req-1fd3ab92-d13d-4679-9264-529c5a8d19f7'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:28.922540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ec6fa2d34d47b4ad34d7b64f74cbbb', 'request_id': 'req-1fd3ab92-d13d-4679-9264-529c5a8d19f7'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:28.934271 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] The token cache is being invalidate because project 32ec6fa2d34d47b4ad34d7b64f74cbbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:28.934556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:28.935264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:28.936829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1253/2516] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:28 2022] DELETE /identity/v3/projects/32ec6fa2d34d47b4ad34d7b64f74cbbb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:28.940734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:28.942149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:28.955228 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4741-cd79-47bd-883a-bab9cb53f382 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:29.007868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c59f6-6c14-403c-a0b5-719d192b7e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:29.008700 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c59f6-6c14-403c-a0b5-719d192b7e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:29.008973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c59f6-6c14-403c-a0b5-719d192b7e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:29.009237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c59f6-6c14-403c-a0b5-719d192b7e8a admin admin] PATH_INFO: `/v3/users/f9d584577487447aa20ced77ac8d0406` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:29.010888 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c59f6-6c14-403c-a0b5-719d192b7e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d584577487447aa20ced77ac8d0406)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:29.012804 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c59f6-6c14-403c-a0b5-719d192b7e8a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:29.056251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-873c59f6-6c14-403c-a0b5-719d192b7e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d584577487447aa20ced77ac8d0406'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:29.056813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-873c59f6-6c14-403c-a0b5-719d192b7e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d584577487447aa20ced77ac8d0406'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:29.057421 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-873c59f6-6c14-403c-a0b5-719d192b7e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d584577487447aa20ced77ac8d0406'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:29.069229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-873c59f6-6c14-403c-a0b5-719d192b7e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d584577487447aa20ced77ac8d0406'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:29.078791 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-873c59f6-6c14-403c-a0b5-719d192b7e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d584577487447aa20ced77ac8d0406'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:29.092862 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1264/2517] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:28 2022] DELETE /identity/v3/users/f9d584577487447aa20ced77ac8d0406 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:29.259491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:29.261467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:29.273830 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3ab92-d13d-4679-9264-529c5a8d19f7 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:29.329639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:29.330775 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:29.331103 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:29.331371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] PATH_INFO: `/v3/projects/1ca020b2083c408391d61908a578da51` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:29.332639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca020b2083c408391d61908a578da51)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:29.334556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:29.378336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca020b2083c408391d61908a578da51', 'request_id': 'req-a57076f0-34f4-49e3-a85c-4a7531620e5f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:29.383837 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca020b2083c408391d61908a578da51', 'request_id': 'req-a57076f0-34f4-49e3-a85c-4a7531620e5f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:29.390359 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca020b2083c408391d61908a578da51', 'request_id': 'req-a57076f0-34f4-49e3-a85c-4a7531620e5f'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:29.402846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] The token cache is being invalidate because project 1ca020b2083c408391d61908a578da51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:29.403154 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:29.403764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a57076f0-34f4-49e3-a85c-4a7531620e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:29.405274 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1254/2518] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:29 2022] DELETE /identity/v3/projects/1ca020b2083c408391d61908a578da51 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:29.410119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61d93b-e528-4067-84fb-5e973a5bd205 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:29.410412 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61d93b-e528-4067-84fb-5e973a5bd205 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:29.410697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61d93b-e528-4067-84fb-5e973a5bd205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:29.428333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6c61d93b-e528-4067-84fb-5e973a5bd205 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:29.429522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6c61d93b-e528-4067-84fb-5e973a5bd205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:29.487646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1265/2519] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:29.496291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112cdad-3f3d-4d03-8ff6-c086ef4a77c4 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:29.496578 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112cdad-3f3d-4d03-8ff6-c086ef4a77c4 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:29.496854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112cdad-3f3d-4d03-8ff6-c086ef4a77c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:29.515928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-e112cdad-3f3d-4d03-8ff6-c086ef4a77c4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:29.517122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e112cdad-3f3d-4d03-8ff6-c086ef4a77c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:29.525307 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1255/2520] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:29.529513 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61d93b-e528-4067-84fb-5e973a5bd205 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:29.539187 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61d93b-e528-4067-84fb-5e973a5bd205 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:29.543754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d22d5-dd7a-4f2c-92b4-4148e5d60c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:29.544391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d22d5-dd7a-4f2c-92b4-4148e5d60c6a admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:29.544670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d22d5-dd7a-4f2c-92b4-4148e5d60c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:29.544943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d22d5-dd7a-4f2c-92b4-4148e5d60c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:29.545650 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d22d5-dd7a-4f2c-92b4-4148e5d60c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:43:29.545954 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d22d5-dd7a-4f2c-92b4-4148e5d60c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:29.547585 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d22d5-dd7a-4f2c-92b4-4148e5d60c6a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:29.559263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1266/2521] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:43:29.563628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112cdad-3f3d-4d03-8ff6-c086ef4a77c4 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:29.573342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112cdad-3f3d-4d03-8ff6-c086ef4a77c4 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:29.578099 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a38b4-0f5b-4bb3-958a-56e3b1fdbbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:29.578674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a38b4-0f5b-4bb3-958a-56e3b1fdbbff admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:29.578991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a38b4-0f5b-4bb3-958a-56e3b1fdbbff admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:29.579268 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a38b4-0f5b-4bb3-958a-56e3b1fdbbff admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:29.579957 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a38b4-0f5b-4bb3-958a-56e3b1fdbbff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:29.581842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a38b4-0f5b-4bb3-958a-56e3b1fdbbff admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:29.606316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1256/2522] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:29 2022] POST /identity/v3/projects => generated 359 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:29.610294 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d22d5-dd7a-4f2c-92b4-4148e5d60c6a admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:29.620562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d22d5-dd7a-4f2c-92b4-4148e5d60c6a admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:29.675176 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8f138-105d-4b65-9d17-823884024d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:29.675834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8f138-105d-4b65-9d17-823884024d10 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:29.676115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8f138-105d-4b65-9d17-823884024d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:29.676388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8f138-105d-4b65-9d17-823884024d10 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:29.677067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8f138-105d-4b65-9d17-823884024d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:29.678994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8f138-105d-4b65-9d17-823884024d10 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:29.698122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1267/2523] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:29 2022] POST /identity/v3/users => generated 280 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:29.702108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a38b4-0f5b-4bb3-958a-56e3b1fdbbff admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:29.712285 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a38b4-0f5b-4bb3-958a-56e3b1fdbbff admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:29.716896 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc66a3-d6d3-4608-a477-b9954085ee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:29.717564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc66a3-d6d3-4608-a477-b9954085ee23 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:29.717836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc66a3-d6d3-4608-a477-b9954085ee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:29.718105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc66a3-d6d3-4608-a477-b9954085ee23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:29.718814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc66a3-d6d3-4608-a477-b9954085ee23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:29.720434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc66a3-d6d3-4608-a477-b9954085ee23 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:29.730865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1257/2524] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:29.734397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8f138-105d-4b65-9d17-823884024d10 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:29.744526 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8f138-105d-4b65-9d17-823884024d10 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:29.749753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fda49-6bfc-4481-b3cc-6d059b510ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:29.750390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fda49-6bfc-4481-b3cc-6d059b510ace admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:29.750670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fda49-6bfc-4481-b3cc-6d059b510ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:29.750973 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fda49-6bfc-4481-b3cc-6d059b510ace admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:29.751688 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fda49-6bfc-4481-b3cc-6d059b510ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:29.753257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fda49-6bfc-4481-b3cc-6d059b510ace admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:29.763124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1268/2525] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:29.766971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc66a3-d6d3-4608-a477-b9954085ee23 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:29.776511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc66a3-d6d3-4608-a477-b9954085ee23 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:29.780987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e0103-cba0-4dad-aa0e-1b445c9a5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:29.781832 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e0103-cba0-4dad-aa0e-1b445c9a5689 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:29.782107 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e0103-cba0-4dad-aa0e-1b445c9a5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:29.782373 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e0103-cba0-4dad-aa0e-1b445c9a5689 admin admin] PATH_INFO: `/v3/projects/72d51cc0d0184fefa08c4a803f4af02c/users/d8ec50755ef342258e0f9748460da92d/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:29.796758 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e0103-cba0-4dad-aa0e-1b445c9a5689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d51cc0d0184fefa08c4a803f4af02c, user_id=d8ec50755ef342258e0f9748460da92d, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:29.799478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e0103-cba0-4dad-aa0e-1b445c9a5689 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:29.813199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1258/2526] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:29 2022] PUT /identity/v3/projects/72d51cc0d0184fefa08c4a803f4af02c/users/d8ec50755ef342258e0f9748460da92d/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:29.823665 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13bfd0-3945-4413-b798-ba9b4b537d3c None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:29.823981 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13bfd0-3945-4413-b798-ba9b4b537d3c None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:29.824259 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13bfd0-3945-4413-b798-ba9b4b537d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:29.850276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-0f13bfd0-3945-4413-b798-ba9b4b537d3c None None] MFA Rules not processed for user `d8ec50755ef342258e0f9748460da92d`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:29.851914 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0f13bfd0-3945-4413-b798-ba9b4b537d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:29.918717 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1269/2527] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:29 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:29.949883 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e0103-cba0-4dad-aa0e-1b445c9a5689 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:29.951610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-bd6e0103-cba0-4dad-aa0e-1b445c9a5689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:30.006416 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e0103-cba0-4dad-aa0e-1b445c9a5689 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:30.010211 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef5758-aaf0-4ed0-b721-a2dfde105fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:30.010835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef5758-aaf0-4ed0-b721-a2dfde105fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:30.011134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef5758-aaf0-4ed0-b721-a2dfde105fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:30.011403 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef5758-aaf0-4ed0-b721-a2dfde105fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:30.019660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef5758-aaf0-4ed0-b721-a2dfde105fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:30.021064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef5758-aaf0-4ed0-b721-a2dfde105fc4 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:30.030134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1259/2528] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:29 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:30.044396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13bfd0-3945-4413-b798-ba9b4b537d3c None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:30.106120 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13bfd0-3945-4413-b798-ba9b4b537d3c None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:30.110654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:30.111535 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:30.111845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:30.112133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] PATH_INFO: `/v3/users/d8ec50755ef342258e0f9748460da92d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:30.113338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ec50755ef342258e0f9748460da92d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:30.115287 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:30.168347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ec50755ef342258e0f9748460da92d'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:30.169023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ec50755ef342258e0f9748460da92d'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:30.169704 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ec50755ef342258e0f9748460da92d'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:30.181430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ec50755ef342258e0f9748460da92d'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:30.189068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ec50755ef342258e0f9748460da92d'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:30.201466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1270/2529] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:30 2022] DELETE /identity/v3/users/d8ec50755ef342258e0f9748460da92d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:30.205901 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd795eab-aa13-4e7e-88bc-e12b89fb8db2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:30.206189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd795eab-aa13-4e7e-88bc-e12b89fb8db2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:30.206463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd795eab-aa13-4e7e-88bc-e12b89fb8db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:30.223000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-fd795eab-aa13-4e7e-88bc-e12b89fb8db2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:30.224170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-fd795eab-aa13-4e7e-88bc-e12b89fb8db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:30.279410 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1260/2530] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:30.288876 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:30.290269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:30.345683 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932e554-a7b2-4759-94e6-1b3767af3b36 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:30.349302 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049708c2-4036-49c1-b545-362ddc862053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:30.349926 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049708c2-4036-49c1-b545-362ddc862053 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:30.350202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049708c2-4036-49c1-b545-362ddc862053 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:30.350471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049708c2-4036-49c1-b545-362ddc862053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:30.359330 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049708c2-4036-49c1-b545-362ddc862053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:30.360674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049708c2-4036-49c1-b545-362ddc862053 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:30.370227 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1271/2531] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:30.622396 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd795eab-aa13-4e7e-88bc-e12b89fb8db2 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:30.623916 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-fd795eab-aa13-4e7e-88bc-e12b89fb8db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:30.641770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd795eab-aa13-4e7e-88bc-e12b89fb8db2 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:30.649538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:30.651565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:30.652073 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:30.652639 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] PATH_INFO: `/v3/projects/72d51cc0d0184fefa08c4a803f4af02c` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:30.655052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d51cc0d0184fefa08c4a803f4af02c)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:30.659054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:30.704932 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d51cc0d0184fefa08c4a803f4af02c', 'request_id': 'req-aecf40d0-180f-4f71-8871-cd29b78f4ff9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:30.710184 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d51cc0d0184fefa08c4a803f4af02c', 'request_id': 'req-aecf40d0-180f-4f71-8871-cd29b78f4ff9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:30.716885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d51cc0d0184fefa08c4a803f4af02c', 'request_id': 'req-aecf40d0-180f-4f71-8871-cd29b78f4ff9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:30.728580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] The token cache is being invalidate because project 72d51cc0d0184fefa08c4a803f4af02c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:30.728862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:30.729468 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-aecf40d0-180f-4f71-8871-cd29b78f4ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:30.731008 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1261/2532] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:30 2022] DELETE /identity/v3/projects/72d51cc0d0184fefa08c4a803f4af02c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:30.735933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de559c-d8c1-46ce-99a9-0e97b4c0d68a None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:30.736412 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de559c-d8c1-46ce-99a9-0e97b4c0d68a None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:30.736509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de559c-d8c1-46ce-99a9-0e97b4c0d68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:30.754273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-17de559c-d8c1-46ce-99a9-0e97b4c0d68a None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:30.755742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-17de559c-d8c1-46ce-99a9-0e97b4c0d68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:30.812065 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1272/2533] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:30.820503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96f8e2-e842-417e-9937-192697917db8 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:30.820982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96f8e2-e842-417e-9937-192697917db8 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:30.821077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96f8e2-e842-417e-9937-192697917db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:30.839510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-2c96f8e2-e842-417e-9937-192697917db8 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:30.840701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-2c96f8e2-e842-417e-9937-192697917db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:30.848477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1262/2534] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:30.852541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de559c-d8c1-46ce-99a9-0e97b4c0d68a None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:30.862085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de559c-d8c1-46ce-99a9-0e97b4c0d68a None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:30.866860 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daa5e3-14e8-42d1-8776-2d2abffd688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:30.867464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa5e3-14e8-42d1-8776-2d2abffd688f admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:30.867747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa5e3-14e8-42d1-8776-2d2abffd688f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:30.868018 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa5e3-14e8-42d1-8776-2d2abffd688f admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:30.868721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daa5e3-14e8-42d1-8776-2d2abffd688f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:43:30.869022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daa5e3-14e8-42d1-8776-2d2abffd688f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:30.871135 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daa5e3-14e8-42d1-8776-2d2abffd688f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:30.882603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1273/2535] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:43:30.887349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96f8e2-e842-417e-9937-192697917db8 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:30.896180 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96f8e2-e842-417e-9937-192697917db8 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:30.900813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc59d-c516-46d4-a263-073279a499fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:30.901444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc59d-c516-46d4-a263-073279a499fc admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:30.901724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc59d-c516-46d4-a263-073279a499fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:30.901998 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc59d-c516-46d4-a263-073279a499fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:30.902710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bc59d-c516-46d4-a263-073279a499fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:30.904630 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bc59d-c516-46d4-a263-073279a499fc admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:30.932419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1263/2536] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:30 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:30.934457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daa5e3-14e8-42d1-8776-2d2abffd688f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:30.944229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daa5e3-14e8-42d1-8776-2d2abffd688f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:30.997578 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4cd47-5ed7-423d-9151-27d20da9f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:30.998220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cd47-5ed7-423d-9151-27d20da9f93c admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:30.998498 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cd47-5ed7-423d-9151-27d20da9f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:30.998768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cd47-5ed7-423d-9151-27d20da9f93c admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:30.999481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4cd47-5ed7-423d-9151-27d20da9f93c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:31.001369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4cd47-5ed7-423d-9151-27d20da9f93c admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:31.021253 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1274/2537] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:30 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:31.025420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc59d-c516-46d4-a263-073279a499fc admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:31.035717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc59d-c516-46d4-a263-073279a499fc admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:31.040318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a276a0-7ea2-40a6-9dc6-dfb42c52a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:31.040955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a276a0-7ea2-40a6-9dc6-dfb42c52a5bf admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:31.041233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a276a0-7ea2-40a6-9dc6-dfb42c52a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:31.041506 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a276a0-7ea2-40a6-9dc6-dfb42c52a5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:31.042234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a276a0-7ea2-40a6-9dc6-dfb42c52a5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:31.043835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a276a0-7ea2-40a6-9dc6-dfb42c52a5bf admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:31.053848 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1264/2538] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:31.058081 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4cd47-5ed7-423d-9151-27d20da9f93c admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:31.067510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4cd47-5ed7-423d-9151-27d20da9f93c admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:31.072039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfdb77-48a3-44a9-8508-88841103a1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:31.072720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfdb77-48a3-44a9-8508-88841103a1ae admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:31.073523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfdb77-48a3-44a9-8508-88841103a1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:31.073799 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfdb77-48a3-44a9-8508-88841103a1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:31.074501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfdb77-48a3-44a9-8508-88841103a1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:31.076109 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfdb77-48a3-44a9-8508-88841103a1ae admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:31.086759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1275/2539] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:31.090821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a276a0-7ea2-40a6-9dc6-dfb42c52a5bf admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:31.100787 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a276a0-7ea2-40a6-9dc6-dfb42c52a5bf admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:31.105307 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518353f-3d0c-4fd1-8afd-5216aba089e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:31.106170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518353f-3d0c-4fd1-8afd-5216aba089e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:31.106447 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518353f-3d0c-4fd1-8afd-5216aba089e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:31.106716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518353f-3d0c-4fd1-8afd-5216aba089e0 admin admin] PATH_INFO: `/v3/projects/4c935baccaf04b40b47b1e1810518846/users/d739fb114a5843e8b542bda07bb06abf/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:31.121144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518353f-3d0c-4fd1-8afd-5216aba089e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c935baccaf04b40b47b1e1810518846, user_id=d739fb114a5843e8b542bda07bb06abf, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:31.123751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518353f-3d0c-4fd1-8afd-5216aba089e0 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:31.137759 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1265/2540] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:31 2022] PUT /identity/v3/projects/4c935baccaf04b40b47b1e1810518846/users/d739fb114a5843e8b542bda07bb06abf/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:31.147743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e64aba-53c4-459a-9465-41ba38bd117b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:31.148057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e64aba-53c4-459a-9465-41ba38bd117b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:31.148334 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e64aba-53c4-459a-9465-41ba38bd117b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:31.174645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-97e64aba-53c4-459a-9465-41ba38bd117b None None] MFA Rules not processed for user `d739fb114a5843e8b542bda07bb06abf`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:31.175863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-97e64aba-53c4-459a-9465-41ba38bd117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:31.236582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1276/2541] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:31.247461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518353f-3d0c-4fd1-8afd-5216aba089e0 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:31.249116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0518353f-3d0c-4fd1-8afd-5216aba089e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:31.303094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518353f-3d0c-4fd1-8afd-5216aba089e0 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:31.306653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd363-6a77-4a35-a30c-d273fbc736d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:31.307923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd363-6a77-4a35-a30c-d273fbc736d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:31.308195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd363-6a77-4a35-a30c-d273fbc736d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:31.308460 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd363-6a77-4a35-a30c-d273fbc736d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:31.317514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bd363-6a77-4a35-a30c-d273fbc736d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:31.319605 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bd363-6a77-4a35-a30c-d273fbc736d0 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:31.328598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1266/2542] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:34.273268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e64aba-53c4-459a-9465-41ba38bd117b None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:34.332610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e64aba-53c4-459a-9465-41ba38bd117b None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:34.337053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:34.337900 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:34.338198 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:34.338469 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] PATH_INFO: `/v3/users/d739fb114a5843e8b542bda07bb06abf` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:34.339668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d739fb114a5843e8b542bda07bb06abf)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:34.341560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:34.385038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd739fb114a5843e8b542bda07bb06abf'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:34.385675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd739fb114a5843e8b542bda07bb06abf'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:34.386276 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd739fb114a5843e8b542bda07bb06abf'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:34.397415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd739fb114a5843e8b542bda07bb06abf'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:34.403790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd739fb114a5843e8b542bda07bb06abf'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:34.415555 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1277/2543] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:34 2022] DELETE /identity/v3/users/d739fb114a5843e8b542bda07bb06abf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:34.420488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9f4c0-31d0-4a96-9553-dcdb9daf6c6e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:34.420968 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9f4c0-31d0-4a96-9553-dcdb9daf6c6e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:34.421070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9f4c0-31d0-4a96-9553-dcdb9daf6c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:34.438404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-fda9f4c0-31d0-4a96-9553-dcdb9daf6c6e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:34.440290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-fda9f4c0-31d0-4a96-9553-dcdb9daf6c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:34.500032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1267/2544] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:34.510379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:34.512317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:34.571186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890acbe-b1df-4058-8ec1-0ebed29fd16d admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:34.574859 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4e8ea-eded-4fd7-8c4d-3964eecd7674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:34.575528 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4e8ea-eded-4fd7-8c4d-3964eecd7674 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:34.575808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4e8ea-eded-4fd7-8c4d-3964eecd7674 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:34.576108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4e8ea-eded-4fd7-8c4d-3964eecd7674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:34.585047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4e8ea-eded-4fd7-8c4d-3964eecd7674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:34.586457 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4e8ea-eded-4fd7-8c4d-3964eecd7674 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:34.594772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9f4c0-31d0-4a96-9553-dcdb9daf6c6e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:34.596166 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-fda9f4c0-31d0-4a96-9553-dcdb9daf6c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:34.596666 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1278/2545] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:34.608354 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9f4c0-31d0-4a96-9553-dcdb9daf6c6e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:34.613063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:34.613914 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:34.614186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:34.614452 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] PATH_INFO: `/v3/users/97b402faf653441f9680abbc08186a3b` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:34.615644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b402faf653441f9680abbc08186a3b)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:34.617556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:34.800644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b402faf653441f9680abbc08186a3b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:34.801089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b402faf653441f9680abbc08186a3b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:34.814499 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b402faf653441f9680abbc08186a3b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:34.821954 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b402faf653441f9680abbc08186a3b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:34.829317 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b402faf653441f9680abbc08186a3b'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:34.835973 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1268/2546] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:34 2022] DELETE /identity/v3/users/97b402faf653441f9680abbc08186a3b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:34.841762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28b18-16b3-4648-8eff-819b293513b6 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:34.842178 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28b18-16b3-4648-8eff-819b293513b6 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:34.842532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28b18-16b3-4648-8eff-819b293513b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:34.862626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-dcc28b18-16b3-4648-8eff-819b293513b6 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:34.864013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-dcc28b18-16b3-4648-8eff-819b293513b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:34.920605 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:34.922023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:34.929444 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1279/2547] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:34.936565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e7c9d-6c11-4078-b5d9-97a89af6497a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:34.942444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:34.943324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:34.943598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:34.943869 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] PATH_INFO: `/v3/projects/4c935baccaf04b40b47b1e1810518846` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:34.943985 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28b18-16b3-4648-8eff-819b293513b6 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:34.945052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c935baccaf04b40b47b1e1810518846)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:34.946262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-dcc28b18-16b3-4648-8eff-819b293513b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:34.947830 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:34.994481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c935baccaf04b40b47b1e1810518846', 'request_id': 'req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:34.999987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c935baccaf04b40b47b1e1810518846', 'request_id': 'req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.004326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28b18-16b3-4648-8eff-819b293513b6 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.007212 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c935baccaf04b40b47b1e1810518846', 'request_id': 'req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.020345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] The token cache is being invalidate because project 4c935baccaf04b40b47b1e1810518846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:35.020747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.021477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-8be1f4e7-4d9d-4ccf-bcc0-43f9b0baa3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.023133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1269/2548] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:34 2022] DELETE /identity/v3/projects/4c935baccaf04b40b47b1e1810518846 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:35.028488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68efe3-f4b8-4cf9-bfa0-8bf00ed4d0d2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.028765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68efe3-f4b8-4cf9-bfa0-8bf00ed4d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.029030 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68efe3-f4b8-4cf9-bfa0-8bf00ed4d0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.046443 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ad68efe3-f4b8-4cf9-bfa0-8bf00ed4d0d2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:35.047695 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ad68efe3-f4b8-4cf9-bfa0-8bf00ed4d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.055812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f333c7-10b8-420a-83f1-b9807dabdd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.056449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f333c7-10b8-420a-83f1-b9807dabdd80 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.056747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f333c7-10b8-420a-83f1-b9807dabdd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.057020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f333c7-10b8-420a-83f1-b9807dabdd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.058769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-99f333c7-10b8-420a-83f1-b9807dabdd80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.106756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1270/2549] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:35.114282 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d9c63-5518-4fde-92b1-8e3a2610e345 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.114563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d9c63-5518-4fde-92b1-8e3a2610e345 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.114830 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d9c63-5518-4fde-92b1-8e3a2610e345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.122944 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f333c7-10b8-420a-83f1-b9807dabdd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.124377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f333c7-10b8-420a-83f1-b9807dabdd80 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.132403 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-783d9c63-5518-4fde-92b1-8e3a2610e345 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:35.133552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-783d9c63-5518-4fde-92b1-8e3a2610e345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.134054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1280/2550] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:43:35.141305 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1271/2551] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:35.145375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f333c7-10b8-420a-83f1-b9807dabdd80 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.154863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f333c7-10b8-420a-83f1-b9807dabdd80 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.159643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c49a0-74d7-4374-8edd-190af6c9cd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.160376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c49a0-74d7-4374-8edd-190af6c9cd27 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.160678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c49a0-74d7-4374-8edd-190af6c9cd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.160962 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c49a0-74d7-4374-8edd-190af6c9cd27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.161677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c49a0-74d7-4374-8edd-190af6c9cd27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:43:35.161981 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c49a0-74d7-4374-8edd-190af6c9cd27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.163679 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c49a0-74d7-4374-8edd-190af6c9cd27 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.175775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1281/2552] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:43:35.179867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d9c63-5518-4fde-92b1-8e3a2610e345 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.189463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d9c63-5518-4fde-92b1-8e3a2610e345 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.194274 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd360e-4ced-4625-bab8-7095f1a78a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.194925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd360e-4ced-4625-bab8-7095f1a78a3e admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.195311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd360e-4ced-4625-bab8-7095f1a78a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.195609 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd360e-4ced-4625-bab8-7095f1a78a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.196321 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd360e-4ced-4625-bab8-7095f1a78a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.198240 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd360e-4ced-4625-bab8-7095f1a78a3e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.224737 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1272/2553] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:35 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:43:35.229885 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c49a0-74d7-4374-8edd-190af6c9cd27 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.239037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c49a0-74d7-4374-8edd-190af6c9cd27 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.298314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bc8a3-0dc6-459e-b5f4-0dbba14bcfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.299008 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bc8a3-0dc6-459e-b5f4-0dbba14bcfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.299292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bc8a3-0dc6-459e-b5f4-0dbba14bcfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.299561 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bc8a3-0dc6-459e-b5f4-0dbba14bcfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.300242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bc8a3-0dc6-459e-b5f4-0dbba14bcfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.302144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bc8a3-0dc6-459e-b5f4-0dbba14bcfb6 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.322007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1282/2554] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:35 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:43:35.325920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd360e-4ced-4625-bab8-7095f1a78a3e admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.336075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd360e-4ced-4625-bab8-7095f1a78a3e admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.341673 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36282dcf-f66d-4f17-bbb0-7d6dddea3756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.342358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282dcf-f66d-4f17-bbb0-7d6dddea3756 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.342634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282dcf-f66d-4f17-bbb0-7d6dddea3756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.342926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282dcf-f66d-4f17-bbb0-7d6dddea3756 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.343698 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36282dcf-f66d-4f17-bbb0-7d6dddea3756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.345211 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36282dcf-f66d-4f17-bbb0-7d6dddea3756 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.356314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1273/2555] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:35.360256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bc8a3-0dc6-459e-b5f4-0dbba14bcfb6 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.370205 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bc8a3-0dc6-459e-b5f4-0dbba14bcfb6 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.374817 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5109a-2a05-41e3-899b-fd79ca8a2343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.375494 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5109a-2a05-41e3-899b-fd79ca8a2343 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.375914 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5109a-2a05-41e3-899b-fd79ca8a2343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.376135 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5109a-2a05-41e3-899b-fd79ca8a2343 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.376830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5109a-2a05-41e3-899b-fd79ca8a2343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.378567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5109a-2a05-41e3-899b-fd79ca8a2343 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.389776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1283/2556] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:43:35.393931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36282dcf-f66d-4f17-bbb0-7d6dddea3756 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.398179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5109a-2a05-41e3-899b-fd79ca8a2343 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.400127 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3fc5109a-2a05-41e3-899b-fd79ca8a2343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.404424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36282dcf-f66d-4f17-bbb0-7d6dddea3756 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.410947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148651a8-5def-4500-9921-e09a5a18202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.411701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148651a8-5def-4500-9921-e09a5a18202d admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.411975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148651a8-5def-4500-9921-e09a5a18202d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.412367 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148651a8-5def-4500-9921-e09a5a18202d admin admin] PATH_INFO: `/v3/projects/89e47625bd844d5e8c37c9bba092effc/users/c7217301766b4fda8d13c68863280000/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.415149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5109a-2a05-41e3-899b-fd79ca8a2343 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.420439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.421411 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.421809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.422159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] PATH_INFO: `/v3/projects/4d3c263b67cd411bb4f67313b1db7cda` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.423547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d3c263b67cd411bb4f67313b1db7cda)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.425540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.428485 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148651a8-5def-4500-9921-e09a5a18202d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e47625bd844d5e8c37c9bba092effc, user_id=c7217301766b4fda8d13c68863280000, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.431201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148651a8-5def-4500-9921-e09a5a18202d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.445056 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1274/2557] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:35 2022] PUT /identity/v3/projects/89e47625bd844d5e8c37c9bba092effc/users/c7217301766b4fda8d13c68863280000/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:35.454799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93b09-a1d9-4d95-a26d-e8aadec802c6 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.455133 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93b09-a1d9-4d95-a26d-e8aadec802c6 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.455425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93b09-a1d9-4d95-a26d-e8aadec802c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.473612 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d3c263b67cd411bb4f67313b1db7cda', 'request_id': 'req-89a9b8d6-2a75-47df-be45-c012d9f4a06f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.479502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d3c263b67cd411bb4f67313b1db7cda', 'request_id': 'req-89a9b8d6-2a75-47df-be45-c012d9f4a06f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.481955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-93c93b09-a1d9-4d95-a26d-e8aadec802c6 None None] MFA Rules not processed for user `c7217301766b4fda8d13c68863280000`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:35.483210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-93c93b09-a1d9-4d95-a26d-e8aadec802c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.486252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d3c263b67cd411bb4f67313b1db7cda', 'request_id': 'req-89a9b8d6-2a75-47df-be45-c012d9f4a06f'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.498648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] The token cache is being invalidate because project 4d3c263b67cd411bb4f67313b1db7cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:35.498957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.499582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.501119 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1284/2558] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:35 2022] DELETE /identity/v3/projects/4d3c263b67cd411bb4f67313b1db7cda => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:35.505632 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.507082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.553252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1275/2559] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:35.565994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c93b09-a1d9-4d95-a26d-e8aadec802c6 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.567380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-93c93b09-a1d9-4d95-a26d-e8aadec802c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.571375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9b8d6-2a75-47df-be45-c012d9f4a06f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.576305 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f09b6-f852-42eb-a693-7762f4844d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.577220 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f09b6-f852-42eb-a693-7762f4844d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.577493 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f09b6-f852-42eb-a693-7762f4844d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.577932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f09b6-f852-42eb-a693-7762f4844d57 admin admin] PATH_INFO: `/v3/users/ebb8d407eb6849f2b1854b428ad3ca1c` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.579148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f09b6-f852-42eb-a693-7762f4844d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb8d407eb6849f2b1854b428ad3ca1c)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.581260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f09b6-f852-42eb-a693-7762f4844d57 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.625188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c93b09-a1d9-4d95-a26d-e8aadec802c6 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.628481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c65f09b6-f852-42eb-a693-7762f4844d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb8d407eb6849f2b1854b428ad3ca1c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.629089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af680a0d-7d2c-49b5-a3f9-a60a83a5f037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.629212 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c65f09b6-f852-42eb-a693-7762f4844d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb8d407eb6849f2b1854b428ad3ca1c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.629719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af680a0d-7d2c-49b5-a3f9-a60a83a5f037 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.629826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c65f09b6-f852-42eb-a693-7762f4844d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb8d407eb6849f2b1854b428ad3ca1c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.629994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af680a0d-7d2c-49b5-a3f9-a60a83a5f037 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.630518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af680a0d-7d2c-49b5-a3f9-a60a83a5f037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.632401 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-af680a0d-7d2c-49b5-a3f9-a60a83a5f037 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.642313 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c65f09b6-f852-42eb-a693-7762f4844d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb8d407eb6849f2b1854b428ad3ca1c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.643724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af680a0d-7d2c-49b5-a3f9-a60a83a5f037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.645137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af680a0d-7d2c-49b5-a3f9-a60a83a5f037 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.651644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c65f09b6-f852-42eb-a693-7762f4844d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb8d407eb6849f2b1854b428ad3ca1c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.655900 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1276/2560] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:43:35.665783 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1285/2561] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:35 2022] DELETE /identity/v3/users/ebb8d407eb6849f2b1854b428ad3ca1c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:35.680097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af680a0d-7d2c-49b5-a3f9-a60a83a5f037 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.681514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-af680a0d-7d2c-49b5-a3f9-a60a83a5f037 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.694684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af680a0d-7d2c-49b5-a3f9-a60a83a5f037 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.749607 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.750463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.750741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.751043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] PATH_INFO: `/v3/users/c7217301766b4fda8d13c68863280000` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.752241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7217301766b4fda8d13c68863280000)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.754146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.800921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7217301766b4fda8d13c68863280000'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.801599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7217301766b4fda8d13c68863280000'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.813232 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7217301766b4fda8d13c68863280000'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.820635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7217301766b4fda8d13c68863280000'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.828731 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7217301766b4fda8d13c68863280000'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:35.834766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1277/2562] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:35 2022] DELETE /identity/v3/users/c7217301766b4fda8d13c68863280000 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:35.840086 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72af5-6135-4cf0-b3ba-9eb53ff5be34 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.840515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72af5-6135-4cf0-b3ba-9eb53ff5be34 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.840897 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72af5-6135-4cf0-b3ba-9eb53ff5be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.858695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-beb72af5-6135-4cf0-b3ba-9eb53ff5be34 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:35.859947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-beb72af5-6135-4cf0-b3ba-9eb53ff5be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.919529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1286/2563] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:35.931745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.933376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.940817 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb72af5-6135-4cf0-b3ba-9eb53ff5be34 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:35.942193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-beb72af5-6135-4cf0-b3ba-9eb53ff5be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:35.959390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb72af5-6135-4cf0-b3ba-9eb53ff5be34 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.965809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.966741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.966963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.967260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] PATH_INFO: `/v3/projects/07f8289327664ae8bf843f125f94241d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:35.968587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f8289327664ae8bf843f125f94241d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:35.970670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:35.992522 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcd034-2c61-4f0c-bee0-dac8fa1499cb admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:35.996642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06df8-2b56-4434-9184-245dd5a9693b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:35.997342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06df8-2b56-4434-9184-245dd5a9693b service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:35.997650 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06df8-2b56-4434-9184-245dd5a9693b service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:35.997955 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06df8-2b56-4434-9184-245dd5a9693b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.007717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb06df8-2b56-4434-9184-245dd5a9693b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.009139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb06df8-2b56-4434-9184-245dd5a9693b service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.019066 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1278/2564] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:36.019297 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f8289327664ae8bf843f125f94241d', 'request_id': 'req-72673d49-6385-4098-98ca-3c1b270cc177'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:36.024820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f8289327664ae8bf843f125f94241d', 'request_id': 'req-72673d49-6385-4098-98ca-3c1b270cc177'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:36.031531 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f8289327664ae8bf843f125f94241d', 'request_id': 'req-72673d49-6385-4098-98ca-3c1b270cc177'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:36.043845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] The token cache is being invalidate because project 07f8289327664ae8bf843f125f94241d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:36.044134 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:36.044763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-72673d49-6385-4098-98ca-3c1b270cc177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:36.046511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1287/2565] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:35 2022] DELETE /identity/v3/projects/07f8289327664ae8bf843f125f94241d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:36.051235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a310c-a620-4dd6-8c32-53b91e85813c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.051665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a310c-a620-4dd6-8c32-53b91e85813c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.051929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a310c-a620-4dd6-8c32-53b91e85813c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.070022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-048a310c-a620-4dd6-8c32-53b91e85813c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:36.071128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-048a310c-a620-4dd6-8c32-53b91e85813c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:36.133376 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1279/2566] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:36.141575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3bc09-de9a-4d08-8015-7e8c2c6233fb None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.141996 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3bc09-de9a-4d08-8015-7e8c2c6233fb None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.142451 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3bc09-de9a-4d08-8015-7e8c2c6233fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.161585 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-31c3bc09-de9a-4d08-8015-7e8c2c6233fb None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:36.162792 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-31c3bc09-de9a-4d08-8015-7e8c2c6233fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:36.171722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1288/2567] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:36.176392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a310c-a620-4dd6-8c32-53b91e85813c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.186407 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a310c-a620-4dd6-8c32-53b91e85813c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.191034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca896e-d2ba-4b4f-8a39-741834079281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.191674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca896e-d2ba-4b4f-8a39-741834079281 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.191944 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca896e-d2ba-4b4f-8a39-741834079281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.192210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca896e-d2ba-4b4f-8a39-741834079281 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.192980 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca896e-d2ba-4b4f-8a39-741834079281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:43:36.193205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca896e-d2ba-4b4f-8a39-741834079281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.194777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca896e-d2ba-4b4f-8a39-741834079281 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.206996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1280/2568] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:43:36.211155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3bc09-de9a-4d08-8015-7e8c2c6233fb None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.220420 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3bc09-de9a-4d08-8015-7e8c2c6233fb None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.225265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a812b05-67c4-40f0-b032-595477d46a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.225901 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a812b05-67c4-40f0-b032-595477d46a67 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.226206 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a812b05-67c4-40f0-b032-595477d46a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.226476 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a812b05-67c4-40f0-b032-595477d46a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.227253 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a812b05-67c4-40f0-b032-595477d46a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.229219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a812b05-67c4-40f0-b032-595477d46a67 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.257716 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1289/2569] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:36.258876 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca896e-d2ba-4b4f-8a39-741834079281 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.268733 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca896e-d2ba-4b4f-8a39-741834079281 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.286744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a812b05-67c4-40f0-b032-595477d46a67 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.288560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-1a812b05-67c4-40f0-b032-595477d46a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:36.330002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25faf751-6857-4fcb-9179-86664c90a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.330580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faf751-6857-4fcb-9179-86664c90a43c admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.330853 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faf751-6857-4fcb-9179-86664c90a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.331159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faf751-6857-4fcb-9179-86664c90a43c admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.331845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faf751-6857-4fcb-9179-86664c90a43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.333726 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faf751-6857-4fcb-9179-86664c90a43c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.354580 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a812b05-67c4-40f0-b032-595477d46a67 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.355160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1281/2570] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:36.358764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25faf751-6857-4fcb-9179-86664c90a43c admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.362147 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.363088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.363373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.363643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] PATH_INFO: `/v3/projects/89e47625bd844d5e8c37c9bba092effc` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.364834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e47625bd844d5e8c37c9bba092effc)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.366735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.368255 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25faf751-6857-4fcb-9179-86664c90a43c admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.373345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea95a2-163f-4982-8cc9-c89194583212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.373977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea95a2-163f-4982-8cc9-c89194583212 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.374256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea95a2-163f-4982-8cc9-c89194583212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.374528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea95a2-163f-4982-8cc9-c89194583212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.375276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea95a2-163f-4982-8cc9-c89194583212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.376858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea95a2-163f-4982-8cc9-c89194583212 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.389763 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1282/2571] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:43:36.390722 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea95a2-163f-4982-8cc9-c89194583212 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.400545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea95a2-163f-4982-8cc9-c89194583212 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.412867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e47625bd844d5e8c37c9bba092effc', 'request_id': 'req-3b623175-e9c7-49be-b1a0-3284ef2609e9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:36.418645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e47625bd844d5e8c37c9bba092effc', 'request_id': 'req-3b623175-e9c7-49be-b1a0-3284ef2609e9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:36.424648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e47625bd844d5e8c37c9bba092effc', 'request_id': 'req-3b623175-e9c7-49be-b1a0-3284ef2609e9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:36.438094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] The token cache is being invalidate because project 89e47625bd844d5e8c37c9bba092effc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:36.438533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:36.439268 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-3b623175-e9c7-49be-b1a0-3284ef2609e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:36.441103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1290/2572] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:36 2022] DELETE /identity/v3/projects/89e47625bd844d5e8c37c9bba092effc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:36.445430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43deb4-f014-4da0-bf15-6d14c20274fe None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.445720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43deb4-f014-4da0-bf15-6d14c20274fe None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.445995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43deb4-f014-4da0-bf15-6d14c20274fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.456123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84781a31-17b8-4ca2-97f3-9befaf9b5990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.456766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84781a31-17b8-4ca2-97f3-9befaf9b5990 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.457041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84781a31-17b8-4ca2-97f3-9befaf9b5990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.457305 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84781a31-17b8-4ca2-97f3-9befaf9b5990 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.458011 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84781a31-17b8-4ca2-97f3-9befaf9b5990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.459812 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84781a31-17b8-4ca2-97f3-9befaf9b5990 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.463867 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-fb43deb4-f014-4da0-bf15-6d14c20274fe None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:36.465065 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fb43deb4-f014-4da0-bf15-6d14c20274fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:36.470030 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1283/2573] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:43:36.473101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1291/2574] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:36.474174 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84781a31-17b8-4ca2-97f3-9befaf9b5990 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.475882 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-84781a31-17b8-4ca2-97f3-9befaf9b5990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:36.480982 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f214c5-e3fb-497e-a032-ee23bf5e2351 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.481273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f214c5-e3fb-497e-a032-ee23bf5e2351 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.481550 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f214c5-e3fb-497e-a032-ee23bf5e2351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.488664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84781a31-17b8-4ca2-97f3-9befaf9b5990 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.493322 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e359e-8ca0-4757-89cc-27ca8edef72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.494783 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e359e-8ca0-4757-89cc-27ca8edef72d admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.495096 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e359e-8ca0-4757-89cc-27ca8edef72d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.495370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e359e-8ca0-4757-89cc-27ca8edef72d admin admin] PATH_INFO: `/v3/projects/812c82bde3e74ea8b51e222a088ac6eb/users/cd79f260491a414ba1a0c2f087b003d3/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.499814 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c9f214c5-e3fb-497e-a032-ee23bf5e2351 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:36.500988 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c9f214c5-e3fb-497e-a032-ee23bf5e2351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:36.509230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1292/2575] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:36.509799 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e359e-8ca0-4757-89cc-27ca8edef72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=812c82bde3e74ea8b51e222a088ac6eb, user_id=cd79f260491a414ba1a0c2f087b003d3, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.512642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e359e-8ca0-4757-89cc-27ca8edef72d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.513688 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f214c5-e3fb-497e-a032-ee23bf5e2351 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.523284 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f214c5-e3fb-497e-a032-ee23bf5e2351 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.525802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1284/2576] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:36 2022] PUT /identity/v3/projects/812c82bde3e74ea8b51e222a088ac6eb/users/cd79f260491a414ba1a0c2f087b003d3/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:36.536938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883061-b39c-4417-838b-5caad4a2f253 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.537215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883061-b39c-4417-838b-5caad4a2f253 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.537511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883061-b39c-4417-838b-5caad4a2f253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.564701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-78883061-b39c-4417-838b-5caad4a2f253 None None] MFA Rules not processed for user `cd79f260491a414ba1a0c2f087b003d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:36.565880 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-78883061-b39c-4417-838b-5caad4a2f253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:36.579406 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08c97f-c138-4410-ae1b-b05dbf9179de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.580155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08c97f-c138-4410-ae1b-b05dbf9179de admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.580406 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08c97f-c138-4410-ae1b-b05dbf9179de admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.580680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08c97f-c138-4410-ae1b-b05dbf9179de admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.581393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08c97f-c138-4410-ae1b-b05dbf9179de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:43:36.581699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08c97f-c138-4410-ae1b-b05dbf9179de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.583320 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08c97f-c138-4410-ae1b-b05dbf9179de admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.594411 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1293/2577] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:43:36.598697 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08c97f-c138-4410-ae1b-b05dbf9179de admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.608433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08c97f-c138-4410-ae1b-b05dbf9179de admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.613139 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20d01c-28cb-4f88-8d7b-2f24428b0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.613692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20d01c-28cb-4f88-8d7b-2f24428b0ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.613976 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20d01c-28cb-4f88-8d7b-2f24428b0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.614253 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20d01c-28cb-4f88-8d7b-2f24428b0ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.614950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20d01c-28cb-4f88-8d7b-2f24428b0ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.616803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20d01c-28cb-4f88-8d7b-2f24428b0ee3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.626766 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1285/2578] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:36.631336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78883061-b39c-4417-838b-5caad4a2f253 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.642339 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78883061-b39c-4417-838b-5caad4a2f253 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.643683 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1294/2579] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/projects => generated 397 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:43:36.647673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20d01c-28cb-4f88-8d7b-2f24428b0ee3 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.700340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e981dad-9627-4775-8197-fcf776f6012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.700992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981dad-9627-4775-8197-fcf776f6012d admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.701274 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981dad-9627-4775-8197-fcf776f6012d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.701549 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981dad-9627-4775-8197-fcf776f6012d admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.702230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e981dad-9627-4775-8197-fcf776f6012d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.704155 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e981dad-9627-4775-8197-fcf776f6012d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.706393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20d01c-28cb-4f88-8d7b-2f24428b0ee3 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.711051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797420a4-10c9-4081-bd5f-33c540842e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.711705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797420a4-10c9-4081-bd5f-33c540842e5a admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.711995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797420a4-10c9-4081-bd5f-33c540842e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.712273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797420a4-10c9-4081-bd5f-33c540842e5a admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.712996 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797420a4-10c9-4081-bd5f-33c540842e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.714878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797420a4-10c9-4081-bd5f-33c540842e5a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.730214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1286/2580] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:43:36.734157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e981dad-9627-4775-8197-fcf776f6012d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.735166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1295/2581] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:43:36.738885 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797420a4-10c9-4081-bd5f-33c540842e5a admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.749238 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797420a4-10c9-4081-bd5f-33c540842e5a admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.793812 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e981dad-9627-4775-8197-fcf776f6012d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.798343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532aea-3287-42c9-99bc-5ffc50bfaf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.799020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532aea-3287-42c9-99bc-5ffc50bfaf6c admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.799295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532aea-3287-42c9-99bc-5ffc50bfaf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.799563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532aea-3287-42c9-99bc-5ffc50bfaf6c admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.800240 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09532aea-3287-42c9-99bc-5ffc50bfaf6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.802114 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09532aea-3287-42c9-99bc-5ffc50bfaf6c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.804523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752d4ae-886d-41cf-8976-649c65349393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.805179 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752d4ae-886d-41cf-8976-649c65349393 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.805461 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752d4ae-886d-41cf-8976-649c65349393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.805735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752d4ae-886d-41cf-8976-649c65349393 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.806450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752d4ae-886d-41cf-8976-649c65349393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.808127 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752d4ae-886d-41cf-8976-649c65349393 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.820547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1296/2582] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:43:36.824276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1287/2583] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:43:36.824408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752d4ae-886d-41cf-8976-649c65349393 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.825249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532aea-3287-42c9-99bc-5ffc50bfaf6c admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.831811 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752d4ae-886d-41cf-8976-649c65349393 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.834520 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532aea-3287-42c9-99bc-5ffc50bfaf6c admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.836746 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7710547-24fd-4cff-8603-357d79044ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.837458 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7710547-24fd-4cff-8603-357d79044ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.837741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7710547-24fd-4cff-8603-357d79044ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.838510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7710547-24fd-4cff-8603-357d79044ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.839262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7710547-24fd-4cff-8603-357d79044ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.839779 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c11d5-610c-4c18-87d3-90f01620e7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.840405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c11d5-610c-4c18-87d3-90f01620e7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.840680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c11d5-610c-4c18-87d3-90f01620e7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.840829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7710547-24fd-4cff-8603-357d79044ae8 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.840948 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c11d5-610c-4c18-87d3-90f01620e7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.841645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c11d5-610c-4c18-87d3-90f01620e7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.843231 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c11d5-610c-4c18-87d3-90f01620e7a1 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.851103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1297/2584] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:43:36.853713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1288/2585] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:43:36.855634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7710547-24fd-4cff-8603-357d79044ae8 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.858377 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c11d5-610c-4c18-87d3-90f01620e7a1 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.865076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7710547-24fd-4cff-8603-357d79044ae8 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.867745 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c11d5-610c-4c18-87d3-90f01620e7a1 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:36.869815 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b4009-a0c1-4c89-b22a-6de6ff9fc4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.870664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b4009-a0c1-4c89-b22a-6de6ff9fc4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.870981 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b4009-a0c1-4c89-b22a-6de6ff9fc4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.871256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b4009-a0c1-4c89-b22a-6de6ff9fc4e4 admin admin] PATH_INFO: `/v3/projects/280049edf4f641ef929b16cd1d43fa9d/users/897350138dd444b0a3e3297fabcb902c/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.872599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037af19-e356-426a-af16-4ca8b37b2042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:36.873503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037af19-e356-426a-af16-4ca8b37b2042 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.873776 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037af19-e356-426a-af16-4ca8b37b2042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.874042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037af19-e356-426a-af16-4ca8b37b2042 admin admin] PATH_INFO: `/v3/projects/1fb32fd0f681425ba71ff763af16e28e/users/d195ab9a66b148b1a41d72e582f17eb9/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.886141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b4009-a0c1-4c89-b22a-6de6ff9fc4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280049edf4f641ef929b16cd1d43fa9d, user_id=897350138dd444b0a3e3297fabcb902c, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.888371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037af19-e356-426a-af16-4ca8b37b2042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb32fd0f681425ba71ff763af16e28e, user_id=d195ab9a66b148b1a41d72e582f17eb9, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:36.888957 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b4009-a0c1-4c89-b22a-6de6ff9fc4e4 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.891121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037af19-e356-426a-af16-4ca8b37b2042 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:36.902589 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1298/2586] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:36 2022] PUT /identity/v3/projects/280049edf4f641ef929b16cd1d43fa9d/users/897350138dd444b0a3e3297fabcb902c/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:36.904474 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1289/2587] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:36 2022] PUT /identity/v3/projects/1fb32fd0f681425ba71ff763af16e28e/users/d195ab9a66b148b1a41d72e582f17eb9/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:36.910700 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b4009-a0c1-4c89-b22a-6de6ff9fc4e4 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:36.913627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c473c0-e7ca-40f1-9146-377ccd593bd7 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:36.914112 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c473c0-e7ca-40f1-9146-377ccd593bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:36.914421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c473c0-e7ca-40f1-9146-377ccd593bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:36.944872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-57c473c0-e7ca-40f1-9146-377ccd593bd7 None None] MFA Rules not processed for user `897350138dd444b0a3e3297fabcb902c`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:36.946140 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-57c473c0-e7ca-40f1-9146-377ccd593bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:36.975904 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b4009-a0c1-4c89-b22a-6de6ff9fc4e4 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:37.008589 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1290/2588] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:37.020365 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c473c0-e7ca-40f1-9146-377ccd593bd7 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:37.021685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-57c473c0-e7ca-40f1-9146-377ccd593bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:37.031173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72df2a-5024-4655-9370-d0e3587c4b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:37.031921 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72df2a-5024-4655-9370-d0e3587c4b83 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:37.032281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72df2a-5024-4655-9370-d0e3587c4b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:37.032634 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72df2a-5024-4655-9370-d0e3587c4b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:37.033430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72df2a-5024-4655-9370-d0e3587c4b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:37.035103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72df2a-5024-4655-9370-d0e3587c4b83 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:37.048004 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1299/2589] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:37.049068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72df2a-5024-4655-9370-d0e3587c4b83 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:37.058963 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72df2a-5024-4655-9370-d0e3587c4b83 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:37.063602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0263df3-a043-4865-9755-1334b9e491cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:37.064448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0263df3-a043-4865-9755-1334b9e491cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:37.064731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0263df3-a043-4865-9755-1334b9e491cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:37.065007 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0263df3-a043-4865-9755-1334b9e491cf admin admin] PATH_INFO: `/v3/projects/1fb32fd0f681425ba71ff763af16e28e/users/d195ab9a66b148b1a41d72e582f17eb9/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:37.066997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0263df3-a043-4865-9755-1334b9e491cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb32fd0f681425ba71ff763af16e28e, user_id=d195ab9a66b148b1a41d72e582f17eb9, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:37.069593 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0263df3-a043-4865-9755-1334b9e491cf admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:37.076587 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c473c0-e7ca-40f1-9146-377ccd593bd7 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:37.081382 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1300/2590] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:37 2022] PUT /identity/v3/projects/1fb32fd0f681425ba71ff763af16e28e/users/d195ab9a66b148b1a41d72e582f17eb9/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:37.092210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3f0dc-93c5-462d-b7dc-bd940435a8b5 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:37.092551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3f0dc-93c5-462d-b7dc-bd940435a8b5 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:37.092934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3f0dc-93c5-462d-b7dc-bd940435a8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:37.122026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-d4a3f0dc-93c5-462d-b7dc-bd940435a8b5 None None] MFA Rules not processed for user `d195ab9a66b148b1a41d72e582f17eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:37.123302 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d4a3f0dc-93c5-462d-b7dc-bd940435a8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:37.127052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8dcec-ba3a-47fc-a1c6-59e5ff7795ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:37.127734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8dcec-ba3a-47fc-a1c6-59e5ff7795ea service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:37.128008 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8dcec-ba3a-47fc-a1c6-59e5ff7795ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:37.128276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8dcec-ba3a-47fc-a1c6-59e5ff7795ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:37.182603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8dcec-ba3a-47fc-a1c6-59e5ff7795ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:37.184075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8dcec-ba3a-47fc-a1c6-59e5ff7795ea service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:37.189979 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1301/2591] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:37.192949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1291/2592] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:43:37.203547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3f0dc-93c5-462d-b7dc-bd940435a8b5 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:37.203547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d4a3f0dc-93c5-462d-b7dc-bd940435a8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:37.215635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3f0dc-93c5-462d-b7dc-bd940435a8b5 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:37.219545 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b241c-6e70-48f8-ab47-c0e1046bf653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:37.220269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b241c-6e70-48f8-ab47-c0e1046bf653 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:37.220552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b241c-6e70-48f8-ab47-c0e1046bf653 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:37.220848 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b241c-6e70-48f8-ab47-c0e1046bf653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:37.277034 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b241c-6e70-48f8-ab47-c0e1046bf653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:37.278467 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b241c-6e70-48f8-ab47-c0e1046bf653 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:37.288061 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1302/2593] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:48.730251 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8dcec-ba3a-47fc-a1c6-59e5ff7795ea service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:48.738519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8dcec-ba3a-47fc-a1c6-59e5ff7795ea service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:48.742071 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031643f8-b6b2-4e5a-9dd5-26c9e78d3415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:48.742688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031643f8-b6b2-4e5a-9dd5-26c9e78d3415 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:48.743000 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031643f8-b6b2-4e5a-9dd5-26c9e78d3415 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:48.743270 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031643f8-b6b2-4e5a-9dd5-26c9e78d3415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:48.752919 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031643f8-b6b2-4e5a-9dd5-26c9e78d3415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:48.754400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031643f8-b6b2-4e5a-9dd5-26c9e78d3415 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:48.765473 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1292/2594] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:49.336148 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b241c-6e70-48f8-ab47-c0e1046bf653 service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:49.396429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b241c-6e70-48f8-ab47-c0e1046bf653 service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:49.401770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:49.402624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:49.402920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:49.403207 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] PATH_INFO: `/v3/users/897350138dd444b0a3e3297fabcb902c` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:49.404428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897350138dd444b0a3e3297fabcb902c)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:49.406388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:49.449125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897350138dd444b0a3e3297fabcb902c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:49.449756 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897350138dd444b0a3e3297fabcb902c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:49.450346 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897350138dd444b0a3e3297fabcb902c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:49.461744 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897350138dd444b0a3e3297fabcb902c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:49.469219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897350138dd444b0a3e3297fabcb902c'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:49.481632 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1303/2595] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:49 2022] DELETE /identity/v3/users/897350138dd444b0a3e3297fabcb902c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:49.486367 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38d38-d1f0-4978-8209-9de82066c235 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:49.486780 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38d38-d1f0-4978-8209-9de82066c235 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:49.487122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38d38-d1f0-4978-8209-9de82066c235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:49.504251 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0bd38d38-d1f0-4978-8209-9de82066c235 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:49.505684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0bd38d38-d1f0-4978-8209-9de82066c235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:49.561523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1293/2596] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:49.571013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:49.572971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:49.626668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da72a8-2118-4aa6-8b27-c7a7b6a982d7 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:49.630542 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ab471-6a08-4f53-9b0a-480e6cb783ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:49.631199 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ab471-6a08-4f53-9b0a-480e6cb783ba service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:49.631477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ab471-6a08-4f53-9b0a-480e6cb783ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:49.631747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ab471-6a08-4f53-9b0a-480e6cb783ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:49.641042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ab471-6a08-4f53-9b0a-480e6cb783ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:49.642442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ab471-6a08-4f53-9b0a-480e6cb783ba service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:49.651526 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1304/2597] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:49.901398 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd38d38-d1f0-4978-8209-9de82066c235 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:49.902936 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0bd38d38-d1f0-4978-8209-9de82066c235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:49.916800 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd38d38-d1f0-4978-8209-9de82066c235 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:49.922352 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:49.923237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:49.923518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:49.923887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] PATH_INFO: `/v3/projects/280049edf4f641ef929b16cd1d43fa9d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:49.925020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=280049edf4f641ef929b16cd1d43fa9d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:49.926862 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:49.972143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280049edf4f641ef929b16cd1d43fa9d', 'request_id': 'req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:49.977446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280049edf4f641ef929b16cd1d43fa9d', 'request_id': 'req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:49.985511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280049edf4f641ef929b16cd1d43fa9d', 'request_id': 'req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:49.998290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] The token cache is being invalidate because project 280049edf4f641ef929b16cd1d43fa9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:49.998572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:49.999199 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-3d18c47d-716f-4ca3-ae5d-a6c2e015eeaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:50.000693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1294/2598] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:49 2022] DELETE /identity/v3/projects/280049edf4f641ef929b16cd1d43fa9d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:50.005864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1c9b7-94b2-49a5-a6df-f8f0fcad6a41 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:50.006150 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1c9b7-94b2-49a5-a6df-f8f0fcad6a41 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:50.006449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1c9b7-94b2-49a5-a6df-f8f0fcad6a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:50.025574 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-05a1c9b7-94b2-49a5-a6df-f8f0fcad6a41 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:50.026775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-05a1c9b7-94b2-49a5-a6df-f8f0fcad6a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:50.089848 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1305/2599] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:50.100128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc27f-f32f-48d9-8658-0230da40d82c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:50.100665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc27f-f32f-48d9-8658-0230da40d82c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:50.101253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc27f-f32f-48d9-8658-0230da40d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:50.124182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-6e1fc27f-f32f-48d9-8658-0230da40d82c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:50.125386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6e1fc27f-f32f-48d9-8658-0230da40d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:50.134070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1295/2600] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:50.137547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1c9b7-94b2-49a5-a6df-f8f0fcad6a41 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:50.147473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1c9b7-94b2-49a5-a6df-f8f0fcad6a41 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:50.152221 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6af7f9-b3c7-4d33-b14e-e40c5046b84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:50.152863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6af7f9-b3c7-4d33-b14e-e40c5046b84f admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:50.153195 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6af7f9-b3c7-4d33-b14e-e40c5046b84f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:50.153417 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6af7f9-b3c7-4d33-b14e-e40c5046b84f admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:50.154128 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6af7f9-b3c7-4d33-b14e-e40c5046b84f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:43:50.154527 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6af7f9-b3c7-4d33-b14e-e40c5046b84f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:50.156775 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6af7f9-b3c7-4d33-b14e-e40c5046b84f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:50.171942 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1306/2601] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:43:50.173147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fc27f-f32f-48d9-8658-0230da40d82c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:50.182665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fc27f-f32f-48d9-8658-0230da40d82c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:50.187242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931aec4-ed29-46b3-bd80-b2e5b959b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:50.187873 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931aec4-ed29-46b3-bd80-b2e5b959b7ec admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:50.188147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931aec4-ed29-46b3-bd80-b2e5b959b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:50.188411 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931aec4-ed29-46b3-bd80-b2e5b959b7ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:50.189337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931aec4-ed29-46b3-bd80-b2e5b959b7ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:50.190997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931aec4-ed29-46b3-bd80-b2e5b959b7ec admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:50.220005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1296/2602] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:50 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:50.221139 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6af7f9-b3c7-4d33-b14e-e40c5046b84f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:50.231550 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6af7f9-b3c7-4d33-b14e-e40c5046b84f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:50.293642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59349-0f80-456c-b4a2-6d89b1425038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:50.294745 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59349-0f80-456c-b4a2-6d89b1425038 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:50.295073 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59349-0f80-456c-b4a2-6d89b1425038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:50.295350 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59349-0f80-456c-b4a2-6d89b1425038 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:50.296087 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b59349-0f80-456c-b4a2-6d89b1425038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:50.298036 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b59349-0f80-456c-b4a2-6d89b1425038 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:50.319951 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1307/2603] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:50 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:50.323983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931aec4-ed29-46b3-bd80-b2e5b959b7ec admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:50.334562 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931aec4-ed29-46b3-bd80-b2e5b959b7ec admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:50.339877 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b7e6-2344-45a5-bb62-628bd3478949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:50.340591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b7e6-2344-45a5-bb62-628bd3478949 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:50.340855 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b7e6-2344-45a5-bb62-628bd3478949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:50.341124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b7e6-2344-45a5-bb62-628bd3478949 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:50.341842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431b7e6-2344-45a5-bb62-628bd3478949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:50.343720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431b7e6-2344-45a5-bb62-628bd3478949 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:50.357424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1297/2604] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:50.358606 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59349-0f80-456c-b4a2-6d89b1425038 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:50.371318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59349-0f80-456c-b4a2-6d89b1425038 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:50.375968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68d493-f226-41e4-81b1-47286066f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:50.376609 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68d493-f226-41e4-81b1-47286066f202 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:50.376891 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68d493-f226-41e4-81b1-47286066f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:50.377165 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68d493-f226-41e4-81b1-47286066f202 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:50.377878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68d493-f226-41e4-81b1-47286066f202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:50.379604 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68d493-f226-41e4-81b1-47286066f202 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:50.389465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1308/2605] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:43:50.393429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b7e6-2344-45a5-bb62-628bd3478949 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:50.403704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b7e6-2344-45a5-bb62-628bd3478949 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:50.408111 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd6b79-caa5-4584-a2cf-da25add6f77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:50.408964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd6b79-caa5-4584-a2cf-da25add6f77e admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:50.409233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd6b79-caa5-4584-a2cf-da25add6f77e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:50.409494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd6b79-caa5-4584-a2cf-da25add6f77e admin admin] PATH_INFO: `/v3/projects/22ea02f677704fa687a93d29125ca6a3/users/190e89da56994743b62d3b573527b405/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:50.423840 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd6b79-caa5-4584-a2cf-da25add6f77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ea02f677704fa687a93d29125ca6a3, user_id=190e89da56994743b62d3b573527b405, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:50.426420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd6b79-caa5-4584-a2cf-da25add6f77e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:50.439663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1298/2606] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:50 2022] PUT /identity/v3/projects/22ea02f677704fa687a93d29125ca6a3/users/190e89da56994743b62d3b573527b405/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:50.444656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf658ac9-8cfd-4847-b7c6-32dddf120f5e None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:50.444942 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf658ac9-8cfd-4847-b7c6-32dddf120f5e None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:50.445218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf658ac9-8cfd-4847-b7c6-32dddf120f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:50.463725 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-cf658ac9-8cfd-4847-b7c6-32dddf120f5e None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:50.465057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cf658ac9-8cfd-4847-b7c6-32dddf120f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:50.522201 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1309/2607] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:50.532253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd6b79-caa5-4584-a2cf-da25add6f77e admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:50.533937 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-fdbd6b79-caa5-4584-a2cf-da25add6f77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:50.588436 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd6b79-caa5-4584-a2cf-da25add6f77e admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:50.592037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d015a4-591e-4d58-9315-9ee4840aac9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:50.592672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d015a4-591e-4d58-9315-9ee4840aac9d service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:50.592946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d015a4-591e-4d58-9315-9ee4840aac9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:50.593211 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d015a4-591e-4d58-9315-9ee4840aac9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:50.602284 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d015a4-591e-4d58-9315-9ee4840aac9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:50.604436 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d015a4-591e-4d58-9315-9ee4840aac9d service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:50.613718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1299/2608] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:53.672156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf658ac9-8cfd-4847-b7c6-32dddf120f5e None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:53.674124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cf658ac9-8cfd-4847-b7c6-32dddf120f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:53.690714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf658ac9-8cfd-4847-b7c6-32dddf120f5e None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:53.711721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:53.713370 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:53.713823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:53.714286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] PATH_INFO: `/v3/users/cd79f260491a414ba1a0c2f087b003d3` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:53.715753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd79f260491a414ba1a0c2f087b003d3)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:53.717649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:53.780189 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd79f260491a414ba1a0c2f087b003d3'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:53.781651 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd79f260491a414ba1a0c2f087b003d3'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:53.782466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd79f260491a414ba1a0c2f087b003d3'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:53.796994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd79f260491a414ba1a0c2f087b003d3'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:53.811023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd79f260491a414ba1a0c2f087b003d3'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:53.825656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1310/2609] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:53 2022] DELETE /identity/v3/users/cd79f260491a414ba1a0c2f087b003d3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:53.830301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9197c4-7096-4fcc-a29d-e795b9a79b03 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:53.830786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9197c4-7096-4fcc-a29d-e795b9a79b03 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:53.830871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9197c4-7096-4fcc-a29d-e795b9a79b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:53.848364 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-9f9197c4-7096-4fcc-a29d-e795b9a79b03 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:53.849584 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9f9197c4-7096-4fcc-a29d-e795b9a79b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:53.920665 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1300/2610] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:43:53.931311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:53.933311 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:54.001782 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063b889-ceee-403f-a86e-32d3c41a4ff8 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:54.006823 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6156462-c22b-4908-a72e-f241736b4820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:54.007569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6156462-c22b-4908-a72e-f241736b4820 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:54.007927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6156462-c22b-4908-a72e-f241736b4820 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:54.008277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6156462-c22b-4908-a72e-f241736b4820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:54.020915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6156462-c22b-4908-a72e-f241736b4820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:54.022423 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6156462-c22b-4908-a72e-f241736b4820 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:54.034329 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1311/2611] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:54.463314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9197c4-7096-4fcc-a29d-e795b9a79b03 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:54.464994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9f9197c4-7096-4fcc-a29d-e795b9a79b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:54.478607 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9197c4-7096-4fcc-a29d-e795b9a79b03 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:54.484569 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:54.485777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:54.486286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:54.486808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] PATH_INFO: `/v3/projects/812c82bde3e74ea8b51e222a088ac6eb` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:54.488249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] RBAC: Authorizing `identity:delete_project(project_id=812c82bde3e74ea8b51e222a088ac6eb)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:54.490698 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:54.536136 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fd61-0f15-4fb7-ae73-c145895311f7 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:54.536456 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fd61-0f15-4fb7-ae73-c145895311f7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:54.537429 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fd61-0f15-4fb7-ae73-c145895311f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:54.553186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812c82bde3e74ea8b51e222a088ac6eb', 'request_id': 'req-46c6cb58-86bb-4d03-8a01-98f8b825746d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:54.560610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812c82bde3e74ea8b51e222a088ac6eb', 'request_id': 'req-46c6cb58-86bb-4d03-8a01-98f8b825746d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:54.565959 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-8a75fd61-0f15-4fb7-ae73-c145895311f7 None None] MFA Rules not processed for user `190e89da56994743b62d3b573527b405`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:54.567289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8a75fd61-0f15-4fb7-ae73-c145895311f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:54.568585 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812c82bde3e74ea8b51e222a088ac6eb', 'request_id': 'req-46c6cb58-86bb-4d03-8a01-98f8b825746d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:54.583301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] The token cache is being invalidate because project 812c82bde3e74ea8b51e222a088ac6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:54.583586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:54.584856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:54.586381 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1301/2612] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:54 2022] DELETE /identity/v3/projects/812c82bde3e74ea8b51e222a088ac6eb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:54.590757 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:54.592925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:54.635786 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1312/2613] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:54.640374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75fd61-0f15-4fb7-ae73-c145895311f7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:54.641796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-8a75fd61-0f15-4fb7-ae73-c145895311f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:54.662922 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6cb58-86bb-4d03-8a01-98f8b825746d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:54.667754 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:54.668617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:54.668928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:54.669382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] PATH_INFO: `/v3/users/d195ab9a66b148b1a41d72e582f17eb9` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:54.671078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d195ab9a66b148b1a41d72e582f17eb9)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:54.673209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:54.730155 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75fd61-0f15-4fb7-ae73-c145895311f7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:54.733602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd195ab9a66b148b1a41d72e582f17eb9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:54.734327 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd195ab9a66b148b1a41d72e582f17eb9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:54.737012 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4307-e5af-4f50-8a3b-0ce6d8d38f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:54.737735 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4307-e5af-4f50-8a3b-0ce6d8d38f0a admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:54.738014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4307-e5af-4f50-8a3b-0ce6d8d38f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:54.738285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4307-e5af-4f50-8a3b-0ce6d8d38f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:54.739008 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c4307-e5af-4f50-8a3b-0ce6d8d38f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:54.741098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c4307-e5af-4f50-8a3b-0ce6d8d38f0a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:54.747977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd195ab9a66b148b1a41d72e582f17eb9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:54.760353 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd195ab9a66b148b1a41d72e582f17eb9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:54.769337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd195ab9a66b148b1a41d72e582f17eb9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:54.779410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1313/2615] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:54 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:43:54.780631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4307-e5af-4f50-8a3b-0ce6d8d38f0a admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:54.780749 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1302/2615] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:54 2022] DELETE /identity/v3/users/d195ab9a66b148b1a41d72e582f17eb9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:54.782799 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7c2c4307-e5af-4f50-8a3b-0ce6d8d38f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:54.889644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4307-e5af-4f50-8a3b-0ce6d8d38f0a admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:55.020281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79502-910f-4b20-9d88-f5d3712b3c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:55.021592 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79502-910f-4b20-9d88-f5d3712b3c79 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.023133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79502-910f-4b20-9d88-f5d3712b3c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.023422 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79502-910f-4b20-9d88-f5d3712b3c79 admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.024158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e79502-910f-4b20-9d88-f5d3712b3c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:55.026122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e79502-910f-4b20-9d88-f5d3712b3c79 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:55.050360 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1314/2616] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:54 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:55.054249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:55.068676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69334b-0e0d-4432-b071-0ffdd5a6d054 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:55.075677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28f36e-0a7e-4d27-bfd3-c85011339d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:55.077169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28f36e-0a7e-4d27-bfd3-c85011339d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.078551 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28f36e-0a7e-4d27-bfd3-c85011339d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.079093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28f36e-0a7e-4d27-bfd3-c85011339d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.080057 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28f36e-0a7e-4d27-bfd3-c85011339d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:55.082486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28f36e-0a7e-4d27-bfd3-c85011339d72 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:55.108126 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1303/2617] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:43:55.112157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79502-910f-4b20-9d88-f5d3712b3c79 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:55.123772 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79502-910f-4b20-9d88-f5d3712b3c79 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:55.130250 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43cb31-c499-4075-92a1-7c24064f7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:55.131182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43cb31-c499-4075-92a1-7c24064f7712 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.131467 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43cb31-c499-4075-92a1-7c24064f7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.131746 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43cb31-c499-4075-92a1-7c24064f7712 admin admin] PATH_INFO: `/v3/projects/70bdad8ea6d744bfbf8ec14f71a0658b/users/8c620358ce31422e82e10854ba8bbade/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.148554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43cb31-c499-4075-92a1-7c24064f7712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70bdad8ea6d744bfbf8ec14f71a0658b, user_id=8c620358ce31422e82e10854ba8bbade, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:55.151439 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43cb31-c499-4075-92a1-7c24064f7712 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:55.173736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1315/2618] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:55 2022] PUT /identity/v3/projects/70bdad8ea6d744bfbf8ec14f71a0658b/users/8c620358ce31422e82e10854ba8bbade/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:55.175696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28f36e-0a7e-4d27-bfd3-c85011339d72 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:55.188716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28f36e-0a7e-4d27-bfd3-c85011339d72 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:55.229378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43cb31-c499-4075-92a1-7c24064f7712 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:55.233312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ba43cb31-c499-4075-92a1-7c24064f7712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:55.291910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8673e06-bae2-4e87-85ff-c1c55b740494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:55.292806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8673e06-bae2-4e87-85ff-c1c55b740494 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.293245 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8673e06-bae2-4e87-85ff-c1c55b740494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.293724 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8673e06-bae2-4e87-85ff-c1c55b740494 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.294733 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8673e06-bae2-4e87-85ff-c1c55b740494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:55.296513 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8673e06-bae2-4e87-85ff-c1c55b740494 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:55.315327 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1304/2619] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:55.318803 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43cb31-c499-4075-92a1-7c24064f7712 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:55.319761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8673e06-bae2-4e87-85ff-c1c55b740494 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:55.331120 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:55.332020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.332312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.332507 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8673e06-bae2-4e87-85ff-c1c55b740494 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:55.332745 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] PATH_INFO: `/v3/projects/1fb32fd0f681425ba71ff763af16e28e` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.334053 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb32fd0f681425ba71ff763af16e28e)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:55.336085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:55.337634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91420c-340a-4bc8-b593-1f48e1778423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:55.338688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91420c-340a-4bc8-b593-1f48e1778423 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.339061 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91420c-340a-4bc8-b593-1f48e1778423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.339342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91420c-340a-4bc8-b593-1f48e1778423 admin admin] PATH_INFO: `/v3/projects/70bdad8ea6d744bfbf8ec14f71a0658b/users/8c620358ce31422e82e10854ba8bbade/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.346800 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91420c-340a-4bc8-b593-1f48e1778423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70bdad8ea6d744bfbf8ec14f71a0658b, user_id=8c620358ce31422e82e10854ba8bbade, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:55.349517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91420c-340a-4bc8-b593-1f48e1778423 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:55.374108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1305/2620] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:55 2022] PUT /identity/v3/projects/70bdad8ea6d744bfbf8ec14f71a0658b/users/8c620358ce31422e82e10854ba8bbade/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:55.396789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb32fd0f681425ba71ff763af16e28e', 'request_id': 'req-79125458-9c95-4eaa-a928-173f029329ba'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:55.403133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb32fd0f681425ba71ff763af16e28e', 'request_id': 'req-79125458-9c95-4eaa-a928-173f029329ba'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:55.411465 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb32fd0f681425ba71ff763af16e28e', 'request_id': 'req-79125458-9c95-4eaa-a928-173f029329ba'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:55.430720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] The token cache is being invalidate because project 1fb32fd0f681425ba71ff763af16e28e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:55.431763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:55.432569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:55.434467 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1316/2621] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:55 2022] DELETE /identity/v3/projects/1fb32fd0f681425ba71ff763af16e28e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:55.441748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac24b7-37db-4135-b787-728dbb081d2d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.442103 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac24b7-37db-4135-b787-728dbb081d2d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.442469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac24b7-37db-4135-b787-728dbb081d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.463562 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-4bac24b7-37db-4135-b787-728dbb081d2d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:55.464503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-4bac24b7-37db-4135-b787-728dbb081d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:55.502640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:55.504158 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:55.551628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1306/2622] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:55.562161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f943c-5eff-48b8-b655-930cec0b4c76 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.562161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f943c-5eff-48b8-b655-930cec0b4c76 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.562684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f943c-5eff-48b8-b655-930cec0b4c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.604675 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-857f943c-5eff-48b8-b655-930cec0b4c76 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:55.607972 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-857f943c-5eff-48b8-b655-930cec0b4c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:55.613021 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79125458-9c95-4eaa-a928-173f029329ba admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:55.644188 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:55.645587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.645868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.646145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] PATH_INFO: `/v3/users/3b5e3d104f1c4a0ba55f9121bc3a0250` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.647693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5e3d104f1c4a0ba55f9121bc3a0250)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:55.649117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1307/2623] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:55.650456 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:55.653462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f943c-5eff-48b8-b655-930cec0b4c76 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:55.662824 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f943c-5eff-48b8-b655-930cec0b4c76 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:55.674935 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badefbca-452d-4d2d-943f-7733517d6c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:55.675767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badefbca-452d-4d2d-943f-7733517d6c2e admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.676301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badefbca-452d-4d2d-943f-7733517d6c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.676681 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badefbca-452d-4d2d-943f-7733517d6c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.677531 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badefbca-452d-4d2d-943f-7733517d6c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:43:55.677921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badefbca-452d-4d2d-943f-7733517d6c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:55.685016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badefbca-452d-4d2d-943f-7733517d6c2e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:55.698777 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1308/2624] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:43:55.702929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badefbca-452d-4d2d-943f-7733517d6c2e admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:55.715489 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badefbca-452d-4d2d-943f-7733517d6c2e admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:55.716762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5e3d104f1c4a0ba55f9121bc3a0250'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:55.717714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5e3d104f1c4a0ba55f9121bc3a0250'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:55.718522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5e3d104f1c4a0ba55f9121bc3a0250'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:55.721498 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a22dab-833a-4161-ac95-c29cd0a0e6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:55.722164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a22dab-833a-4161-ac95-c29cd0a0e6fb admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.722445 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a22dab-833a-4161-ac95-c29cd0a0e6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.722706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a22dab-833a-4161-ac95-c29cd0a0e6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.723702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a22dab-833a-4161-ac95-c29cd0a0e6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:55.726044 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a22dab-833a-4161-ac95-c29cd0a0e6fb admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:55.733747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5e3d104f1c4a0ba55f9121bc3a0250'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:55.743257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5e3d104f1c4a0ba55f9121bc3a0250'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:55.763425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1309/2625] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:43:55 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:43:55.770867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a22dab-833a-4161-ac95-c29cd0a0e6fb admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:55.773338 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-38a22dab-833a-4161-ac95-c29cd0a0e6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:55.781306 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1317/2626] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:43:55 2022] DELETE /identity/v3/users/3b5e3d104f1c4a0ba55f9121bc3a0250 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:55.893178 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a22dab-833a-4161-ac95-c29cd0a0e6fb admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:55.963508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85b391-fcec-490f-abc0-ea2633df0ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:55.965081 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85b391-fcec-490f-abc0-ea2633df0ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:55.965432 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85b391-fcec-490f-abc0-ea2633df0ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:55.965822 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85b391-fcec-490f-abc0-ea2633df0ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:55.966927 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85b391-fcec-490f-abc0-ea2633df0ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:55.969028 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85b391-fcec-490f-abc0-ea2633df0ea4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:56.003273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1310/2627] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:43:55 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:43:56.007728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:56.010571 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:56.021750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85b391-fcec-490f-abc0-ea2633df0ea4 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:56.045571 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85b391-fcec-490f-abc0-ea2633df0ea4 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:56.047649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3a198-ebee-49b4-ae58-b1f1b1824fa3 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:56.051596 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5f23c-82fc-4a61-82ca-17ff01e76c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:56.052335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5f23c-82fc-4a61-82ca-17ff01e76c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:56.052693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5f23c-82fc-4a61-82ca-17ff01e76c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:56.053020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5f23c-82fc-4a61-82ca-17ff01e76c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:56.054296 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5f23c-82fc-4a61-82ca-17ff01e76c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:56.054864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:56.055900 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:56.056353 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:56.056591 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5f23c-82fc-4a61-82ca-17ff01e76c6e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:56.056965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] PATH_INFO: `/v3/projects/26dd6355f38f46af9815bde5526360db` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:56.058293 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26dd6355f38f46af9815bde5526360db)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:56.060511 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:56.071122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1311/2628] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:43:56.076201 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5f23c-82fc-4a61-82ca-17ff01e76c6e admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:56.092621 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5f23c-82fc-4a61-82ca-17ff01e76c6e admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:56.101254 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb145e-1d1c-4416-8899-d0f403e75ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:56.101959 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb145e-1d1c-4416-8899-d0f403e75ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:56.102238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb145e-1d1c-4416-8899-d0f403e75ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:56.102510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb145e-1d1c-4416-8899-d0f403e75ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:56.103484 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb145e-1d1c-4416-8899-d0f403e75ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:56.105290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb145e-1d1c-4416-8899-d0f403e75ce2 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:56.124234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1312/2629] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:43:56.125720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb145e-1d1c-4416-8899-d0f403e75ce2 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:56.129759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26dd6355f38f46af9815bde5526360db', 'request_id': 'req-adfb636d-dbad-412f-b2ac-c3f27de3e861'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:56.137491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb145e-1d1c-4416-8899-d0f403e75ce2 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:56.141666 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26dd6355f38f46af9815bde5526360db', 'request_id': 'req-adfb636d-dbad-412f-b2ac-c3f27de3e861'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:56.148471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26dd6355f38f46af9815bde5526360db', 'request_id': 'req-adfb636d-dbad-412f-b2ac-c3f27de3e861'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:56.169926 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] The token cache is being invalidate because project 26dd6355f38f46af9815bde5526360db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:43:56.170226 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:56.171673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-adfb636d-dbad-412f-b2ac-c3f27de3e861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:43:56.175142 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1318/2630] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:43:56 2022] DELETE /identity/v3/projects/26dd6355f38f46af9815bde5526360db => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:43:56.243784 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb09a7-badc-45f8-943d-7f28a8306c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:56.245889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb09a7-badc-45f8-943d-7f28a8306c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:56.246394 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb09a7-badc-45f8-943d-7f28a8306c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:56.246825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb09a7-badc-45f8-943d-7f28a8306c69 admin admin] PATH_INFO: `/v3/projects/126fe1b9a283418cb17fda5e98a2cdcc/users/27c8de6d052c47c588c9f175ea3b75d9/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:56.279461 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb09a7-badc-45f8-943d-7f28a8306c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=126fe1b9a283418cb17fda5e98a2cdcc, user_id=27c8de6d052c47c588c9f175ea3b75d9, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:56.281961 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb09a7-badc-45f8-943d-7f28a8306c69 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:56.302892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1313/2631] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:43:56 2022] PUT /identity/v3/projects/126fe1b9a283418cb17fda5e98a2cdcc/users/27c8de6d052c47c588c9f175ea3b75d9/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:43:56.319197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ca8f-d647-4652-9e13-71f895e3b994 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:56.319473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ca8f-d647-4652-9e13-71f895e3b994 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:56.319793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ca8f-d647-4652-9e13-71f895e3b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:56.365229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-b2d5ca8f-d647-4652-9e13-71f895e3b994 None None] MFA Rules not processed for user `27c8de6d052c47c588c9f175ea3b75d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:56.366521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-b2d5ca8f-d647-4652-9e13-71f895e3b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:56.463924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1319/2632] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:56.475340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb09a7-badc-45f8-943d-7f28a8306c69 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:56.477355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-80fb09a7-badc-45f8-943d-7f28a8306c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:56.552421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb09a7-badc-45f8-943d-7f28a8306c69 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:56.556929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98f0d8-665d-4b01-be5e-232e553c503e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:56.557580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f0d8-665d-4b01-be5e-232e553c503e service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:56.557850 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f0d8-665d-4b01-be5e-232e553c503e service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:56.558116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f0d8-665d-4b01-be5e-232e553c503e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:56.568157 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98f0d8-665d-4b01-be5e-232e553c503e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:56.569933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98f0d8-665d-4b01-be5e-232e553c503e service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:56.581685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1314/2633] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:58.043780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941fb18-2025-4dea-bbe6-5a520d10e992 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:58.044780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941fb18-2025-4dea-bbe6-5a520d10e992 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:58.045277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941fb18-2025-4dea-bbe6-5a520d10e992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:58.072385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6941fb18-2025-4dea-bbe6-5a520d10e992 None None] MFA Rules not processed for user `27c8de6d052c47c588c9f175ea3b75d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:43:58.074170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6941fb18-2025-4dea-bbe6-5a520d10e992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:58.099019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1320/2634] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:43:58.797767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98f0d8-665d-4b01-be5e-232e553c503e service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:58.799999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7c98f0d8-665d-4b01-be5e-232e553c503e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:58.946006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98f0d8-665d-4b01-be5e-232e553c503e service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:58.953437 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d79c2-cf6f-4989-bc28-b10ad2c65e59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee30c8013ebb40a99d1eac7820d7f1f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:58.954691 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d79c2-cf6f-4989-bc28-b10ad2c65e59 service placement] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:58.955029 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d79c2-cf6f-4989-bc28-b10ad2c65e59 service placement] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:58.955304 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d79c2-cf6f-4989-bc28-b10ad2c65e59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:58.958274 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-637d79c2-cf6f-4989-bc28-b10ad2c65e59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:58.986535 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d79c2-cf6f-4989-bc28-b10ad2c65e59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:58.988419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d79c2-cf6f-4989-bc28-b10ad2c65e59 service placement] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:59.000542 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1315/2635] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:44:01.036247 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f3518-e3d8-4a30-9fb2-5c923c76540e None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:01.037222 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f3518-e3d8-4a30-9fb2-5c923c76540e None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:01.037720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f3518-e3d8-4a30-9fb2-5c923c76540e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:01.066721 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-b24f3518-e3d8-4a30-9fb2-5c923c76540e None None] MFA Rules not processed for user `8c620358ce31422e82e10854ba8bbade`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:01.068275 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-b24f3518-e3d8-4a30-9fb2-5c923c76540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:01.171185 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1321/2636] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:44:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:01.182158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d79c2-cf6f-4989-bc28-b10ad2c65e59 service placement] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:01.184276 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-637d79c2-cf6f-4989-bc28-b10ad2c65e59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:01.269020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d79c2-cf6f-4989-bc28-b10ad2c65e59 service placement] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:01.278427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e2f22-1abb-4c8a-b80f-c27850fb4542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:01.279100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e2f22-1abb-4c8a-b80f-c27850fb4542 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:01.279382 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e2f22-1abb-4c8a-b80f-c27850fb4542 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:01.279654 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e2f22-1abb-4c8a-b80f-c27850fb4542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:01.281903 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-282e2f22-1abb-4c8a-b80f-c27850fb4542 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:01.374463 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e2f22-1abb-4c8a-b80f-c27850fb4542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:01.376502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e2f22-1abb-4c8a-b80f-c27850fb4542 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:01.398055 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1316/2637] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:44:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:44:02.466398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f3518-e3d8-4a30-9fb2-5c923c76540e None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:02.491339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f3518-e3d8-4a30-9fb2-5c923c76540e None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:02.504071 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f04e1c-77b9-4e1c-8245-8a4404f37c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:02.509769 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f04e1c-77b9-4e1c-8245-8a4404f37c00 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:02.510321 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f04e1c-77b9-4e1c-8245-8a4404f37c00 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:02.510776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f04e1c-77b9-4e1c-8245-8a4404f37c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:02.513659 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a1f04e1c-77b9-4e1c-8245-8a4404f37c00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:02.529235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f04e1c-77b9-4e1c-8245-8a4404f37c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:02.531720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f04e1c-77b9-4e1c-8245-8a4404f37c00 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:02.551489 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1322/2638] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:44:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:44:03.044440 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbabaa-1d1c-4252-b571-c7b3c095b1c5 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:03.044925 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbabaa-1d1c-4252-b571-c7b3c095b1c5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:03.045123 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbabaa-1d1c-4252-b571-c7b3c095b1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:03.070729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-ebdbabaa-1d1c-4252-b571-c7b3c095b1c5 None None] MFA Rules not processed for user `190e89da56994743b62d3b573527b405`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:03.072047 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ebdbabaa-1d1c-4252-b571-c7b3c095b1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:03.095819 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1317/2639] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:44:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:08.977678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f04e1c-77b9-4e1c-8245-8a4404f37c00 service nova] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:08.979745 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a1f04e1c-77b9-4e1c-8245-8a4404f37c00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:08.995753 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f04e1c-77b9-4e1c-8245-8a4404f37c00 service nova] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:09.002118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572f2e9-a982-41ba-8327-6bb6cb5398f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:09.003104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572f2e9-a982-41ba-8327-6bb6cb5398f9 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:09.003626 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572f2e9-a982-41ba-8327-6bb6cb5398f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:09.004166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572f2e9-a982-41ba-8327-6bb6cb5398f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:09.006625 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6572f2e9-a982-41ba-8327-6bb6cb5398f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:09.019414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572f2e9-a982-41ba-8327-6bb6cb5398f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:09.020978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572f2e9-a982-41ba-8327-6bb6cb5398f9 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:09.032295 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1323/2640] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:44:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:44:15.949005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf57094-90ac-4534-8bb7-076cb74d502b None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:15.949939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf57094-90ac-4534-8bb7-076cb74d502b None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:15.950077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf57094-90ac-4534-8bb7-076cb74d502b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:15.967309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0cf57094-90ac-4534-8bb7-076cb74d502b None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:15.968455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0cf57094-90ac-4534-8bb7-076cb74d502b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:16.020952 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1318/2641] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:44:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:16.065445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572f2e9-a982-41ba-8327-6bb6cb5398f9 service nova] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:16.066812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6572f2e9-a982-41ba-8327-6bb6cb5398f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:16.135737 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572f2e9-a982-41ba-8327-6bb6cb5398f9 service nova] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:16.140644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54b95a-913e-400d-8849-2104fd4be350 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:16.141277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54b95a-913e-400d-8849-2104fd4be350 service swift] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:16.141557 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54b95a-913e-400d-8849-2104fd4be350 service swift] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:16.141830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54b95a-913e-400d-8849-2104fd4be350 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:16.149719 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54b95a-913e-400d-8849-2104fd4be350 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:16.151393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54b95a-913e-400d-8849-2104fd4be350 service swift] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:16.159369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1324/2642] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:44:16.656734 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02add61-827d-4efc-8978-2fb86221ec46 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:16.657021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02add61-827d-4efc-8978-2fb86221ec46 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:16.657296 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02add61-827d-4efc-8978-2fb86221ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:16.675871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c02add61-827d-4efc-8978-2fb86221ec46 None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:16.676574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c02add61-827d-4efc-8978-2fb86221ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:16.684322 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1319/2643] 10.222.0.44 () {58 vars in 967 bytes} [Mon Feb 28 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:16.696938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54b95a-913e-400d-8849-2104fd4be350 service swift] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:16.707296 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54b95a-913e-400d-8849-2104fd4be350 service swift] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:16.712279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1fbd3-6a6d-4418-b0c5-bd58f7b44355 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:16.712901 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1fbd3-6a6d-4418-b0c5-bd58f7b44355 service swift] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:16.713713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1fbd3-6a6d-4418-b0c5-bd58f7b44355 service swift] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:16.713990 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1fbd3-6a6d-4418-b0c5-bd58f7b44355 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:16.721795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1fbd3-6a6d-4418-b0c5-bd58f7b44355 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:16.723430 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1fbd3-6a6d-4418-b0c5-bd58f7b44355 service swift] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:16.731874 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1325/2644] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:44:16.920124 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1d858-e804-446a-8f17-54d84abe2f3c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:16.920404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1d858-e804-446a-8f17-54d84abe2f3c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:16.920677 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1d858-e804-446a-8f17-54d84abe2f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:16.937579 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-7af1d858-e804-446a-8f17-54d84abe2f3c None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:16.938719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-7af1d858-e804-446a-8f17-54d84abe2f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:16.945582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1320/2645] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:16.957449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1fbd3-6a6d-4418-b0c5-bd58f7b44355 service swift] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:16.968468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1fbd3-6a6d-4418-b0c5-bd58f7b44355 service swift] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:16.973453 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4419726-6cd7-49dd-9eaf-cce9c1804450 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:16.974074 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419726-6cd7-49dd-9eaf-cce9c1804450 service swift] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:16.974354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419726-6cd7-49dd-9eaf-cce9c1804450 service swift] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:16.974628 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419726-6cd7-49dd-9eaf-cce9c1804450 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:16.982471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4419726-6cd7-49dd-9eaf-cce9c1804450 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:16.984067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4419726-6cd7-49dd-9eaf-cce9c1804450 service swift] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:16.991942 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1326/2646] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:44:17.297690 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ea051-d9d2-4065-8886-e232eae90ab1 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:17.298164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ea051-d9d2-4065-8886-e232eae90ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:17.298282 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ea051-d9d2-4065-8886-e232eae90ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:17.315697 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-de1ea051-d9d2-4065-8886-e232eae90ab1 None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:17.316852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-de1ea051-d9d2-4065-8886-e232eae90ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:17.324485 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1321/2647] 10.222.0.44 () {58 vars in 967 bytes} [Mon Feb 28 10:44:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:17.336254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4419726-6cd7-49dd-9eaf-cce9c1804450 service swift] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:17.346433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4419726-6cd7-49dd-9eaf-cce9c1804450 service swift] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:17.351640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044834d7-3531-4252-a462-96473cd69af0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:17.352264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044834d7-3531-4252-a462-96473cd69af0 service swift] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:17.352547 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044834d7-3531-4252-a462-96473cd69af0 service swift] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:17.352822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044834d7-3531-4252-a462-96473cd69af0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:17.360639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044834d7-3531-4252-a462-96473cd69af0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:17.362197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044834d7-3531-4252-a462-96473cd69af0 service swift] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:17.370543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1327/2648] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:44:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:44:19.355164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ea051-d9d2-4065-8886-e232eae90ab1 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:19.356625 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-de1ea051-d9d2-4065-8886-e232eae90ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:19.417627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ea051-d9d2-4065-8886-e232eae90ab1 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:19.421939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:19.422774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:19.423074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:19.423343 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] PATH_INFO: `/v3/users/27c8de6d052c47c588c9f175ea3b75d9` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:19.424509 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c8de6d052c47c588c9f175ea3b75d9)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:19.426393 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:19.470599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c8de6d052c47c588c9f175ea3b75d9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:19.471197 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c8de6d052c47c588c9f175ea3b75d9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:19.482717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c8de6d052c47c588c9f175ea3b75d9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:19.489748 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c8de6d052c47c588c9f175ea3b75d9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:19.496434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c8de6d052c47c588c9f175ea3b75d9'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:19.502160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1322/2649] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:44:19 2022] DELETE /identity/v3/users/27c8de6d052c47c588c9f175ea3b75d9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:44:19.506834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689dc68-a7af-40cc-942e-5ef179dc6fb6 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:19.507320 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689dc68-a7af-40cc-942e-5ef179dc6fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:19.507433 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689dc68-a7af-40cc-942e-5ef179dc6fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:19.524525 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-9689dc68-a7af-40cc-942e-5ef179dc6fb6 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:19.525685 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-9689dc68-a7af-40cc-942e-5ef179dc6fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:19.580523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1328/2650] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:19.590397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:19.591795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:19.646048 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b0948-2f0d-4f8d-b6c8-4c77e6c6593d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:19.649635 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9bad4-f4ad-4631-928b-be3eb2796ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:19.650265 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9bad4-f4ad-4631-928b-be3eb2796ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:19.650540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9bad4-f4ad-4631-928b-be3eb2796ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:19.650814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9bad4-f4ad-4631-928b-be3eb2796ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:19.660016 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9bad4-f4ad-4631-928b-be3eb2796ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:19.661462 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9bad4-f4ad-4631-928b-be3eb2796ee5 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:19.671208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1323/2651] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:44:19.829519 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689dc68-a7af-40cc-942e-5ef179dc6fb6 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:19.830975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-9689dc68-a7af-40cc-942e-5ef179dc6fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:19.843354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689dc68-a7af-40cc-942e-5ef179dc6fb6 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:19.847903 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:19.848748 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:19.849024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:19.849292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] PATH_INFO: `/v3/projects/126fe1b9a283418cb17fda5e98a2cdcc` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:19.850446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=126fe1b9a283418cb17fda5e98a2cdcc)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:19.852539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:19.899145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126fe1b9a283418cb17fda5e98a2cdcc', 'request_id': 'req-2fc05ada-e872-4465-85ae-6c05745dd674'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:19.905112 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126fe1b9a283418cb17fda5e98a2cdcc', 'request_id': 'req-2fc05ada-e872-4465-85ae-6c05745dd674'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:19.911136 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126fe1b9a283418cb17fda5e98a2cdcc', 'request_id': 'req-2fc05ada-e872-4465-85ae-6c05745dd674'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:19.922834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] The token cache is being invalidate because project 126fe1b9a283418cb17fda5e98a2cdcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:44:19.923153 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:19.923768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-2fc05ada-e872-4465-85ae-6c05745dd674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:19.925260 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1329/2652] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:44:19 2022] DELETE /identity/v3/projects/126fe1b9a283418cb17fda5e98a2cdcc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:44:19.930424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad6cf2-3868-4c14-8656-31fc256dd1ca None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:19.930707 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad6cf2-3868-4c14-8656-31fc256dd1ca None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:19.931022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad6cf2-3868-4c14-8656-31fc256dd1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:19.948430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-69ad6cf2-3868-4c14-8656-31fc256dd1ca None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:19.949599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-69ad6cf2-3868-4c14-8656-31fc256dd1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:20.005720 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1324/2653] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:20.014736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70df42-bea3-47aa-b708-88c97a7b8ee4 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:20.015005 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70df42-bea3-47aa-b708-88c97a7b8ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:20.015279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70df42-bea3-47aa-b708-88c97a7b8ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:20.033614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-5b70df42-bea3-47aa-b708-88c97a7b8ee4 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:20.034794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5b70df42-bea3-47aa-b708-88c97a7b8ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:20.043122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1330/2654] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:20.047182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad6cf2-3868-4c14-8656-31fc256dd1ca None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:20.056523 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad6cf2-3868-4c14-8656-31fc256dd1ca None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:20.061524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e3a8c-8b81-4c0f-9da1-ab10a4f63c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:20.062149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e3a8c-8b81-4c0f-9da1-ab10a4f63c15 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:20.062424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e3a8c-8b81-4c0f-9da1-ab10a4f63c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:20.062693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e3a8c-8b81-4c0f-9da1-ab10a4f63c15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:20.063417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e3a8c-8b81-4c0f-9da1-ab10a4f63c15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:44:20.063715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e3a8c-8b81-4c0f-9da1-ab10a4f63c15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:20.065290 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e3a8c-8b81-4c0f-9da1-ab10a4f63c15 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:20.076158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1325/2655] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:44:20.080376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70df42-bea3-47aa-b708-88c97a7b8ee4 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:20.089895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70df42-bea3-47aa-b708-88c97a7b8ee4 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:20.095602 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb309d-ed7e-47a8-ae27-03f78a13bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:20.096264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb309d-ed7e-47a8-ae27-03f78a13bc32 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:20.096541 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb309d-ed7e-47a8-ae27-03f78a13bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:20.096813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb309d-ed7e-47a8-ae27-03f78a13bc32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:20.097492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb309d-ed7e-47a8-ae27-03f78a13bc32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:20.099390 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb309d-ed7e-47a8-ae27-03f78a13bc32 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:20.124471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1331/2656] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:44:20 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:44:20.128525 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e3a8c-8b81-4c0f-9da1-ab10a4f63c15 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:20.138374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e3a8c-8b81-4c0f-9da1-ab10a4f63c15 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:20.191215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fea7ff-63bd-4af2-b591-b23238d722ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:20.191927 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fea7ff-63bd-4af2-b591-b23238d722ca admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:20.192205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fea7ff-63bd-4af2-b591-b23238d722ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:20.192476 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fea7ff-63bd-4af2-b591-b23238d722ca admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:20.193156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fea7ff-63bd-4af2-b591-b23238d722ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:20.195060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fea7ff-63bd-4af2-b591-b23238d722ca admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:20.215149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1326/2657] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:44:20 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:44:20.219117 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb309d-ed7e-47a8-ae27-03f78a13bc32 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:20.229031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb309d-ed7e-47a8-ae27-03f78a13bc32 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:20.234232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e2f19-0ac7-4969-8eb7-4c863f4ff50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:20.234868 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e2f19-0ac7-4969-8eb7-4c863f4ff50d admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:20.235173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e2f19-0ac7-4969-8eb7-4c863f4ff50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:20.235449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e2f19-0ac7-4969-8eb7-4c863f4ff50d admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:20.236182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e2f19-0ac7-4969-8eb7-4c863f4ff50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:20.237747 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e2f19-0ac7-4969-8eb7-4c863f4ff50d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:20.247693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1332/2658] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:44:20.251225 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fea7ff-63bd-4af2-b591-b23238d722ca admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:20.260923 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fea7ff-63bd-4af2-b591-b23238d722ca admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:20.265778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30598ad0-c5d7-4e5b-b62a-e1e69275f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:20.266292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30598ad0-c5d7-4e5b-b62a-e1e69275f769 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:20.266501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30598ad0-c5d7-4e5b-b62a-e1e69275f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:20.266771 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30598ad0-c5d7-4e5b-b62a-e1e69275f769 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:20.267521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30598ad0-c5d7-4e5b-b62a-e1e69275f769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:20.269095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30598ad0-c5d7-4e5b-b62a-e1e69275f769 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:20.279691 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1327/2659] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:44:20.283512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e2f19-0ac7-4969-8eb7-4c863f4ff50d admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:20.293663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e2f19-0ac7-4969-8eb7-4c863f4ff50d admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:20.298219 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a42c02-581c-4a1b-9d35-ee617683bb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:20.299100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42c02-581c-4a1b-9d35-ee617683bb7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:20.299375 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42c02-581c-4a1b-9d35-ee617683bb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:20.299663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42c02-581c-4a1b-9d35-ee617683bb7b admin admin] PATH_INFO: `/v3/projects/7199da134f5348a7adb55be7f0758efe/users/1427c81157ea4c7db763a51954a7e865/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:20.313598 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a42c02-581c-4a1b-9d35-ee617683bb7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7199da134f5348a7adb55be7f0758efe, user_id=1427c81157ea4c7db763a51954a7e865, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:20.316197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a42c02-581c-4a1b-9d35-ee617683bb7b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:20.328264 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1333/2660] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:44:20 2022] PUT /identity/v3/projects/7199da134f5348a7adb55be7f0758efe/users/1427c81157ea4c7db763a51954a7e865/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:44:20.333118 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b15a99-90ed-43fa-99d6-bb4a212b8e39 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:20.333433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b15a99-90ed-43fa-99d6-bb4a212b8e39 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:20.333717 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b15a99-90ed-43fa-99d6-bb4a212b8e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:20.351311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-f4b15a99-90ed-43fa-99d6-bb4a212b8e39 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:20.352467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f4b15a99-90ed-43fa-99d6-bb4a212b8e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:20.407005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1328/2661] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:20.417280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a42c02-581c-4a1b-9d35-ee617683bb7b admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:20.418941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c4a42c02-581c-4a1b-9d35-ee617683bb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:20.472118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a42c02-581c-4a1b-9d35-ee617683bb7b admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:20.475690 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe079570-2dff-4374-bbb6-3b38d4fad7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:20.476308 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079570-2dff-4374-bbb6-3b38d4fad7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:20.476587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079570-2dff-4374-bbb6-3b38d4fad7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:20.476858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079570-2dff-4374-bbb6-3b38d4fad7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:20.486102 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe079570-2dff-4374-bbb6-3b38d4fad7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:20.487544 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe079570-2dff-4374-bbb6-3b38d4fad7b7 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:20.496632 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1334/2662] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:44:24.361058 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e4ff7-ec71-4ae0-ac24-a3db1f8c498d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:24.361581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e4ff7-ec71-4ae0-ac24-a3db1f8c498d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:24.361581 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e4ff7-ec71-4ae0-ac24-a3db1f8c498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:24.388391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-4a3e4ff7-ec71-4ae0-ac24-a3db1f8c498d None None] MFA Rules not processed for user `1427c81157ea4c7db763a51954a7e865`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:24.389519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-4a3e4ff7-ec71-4ae0-ac24-a3db1f8c498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:24.451415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1329/2663] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:44:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:24.455620 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe079570-2dff-4374-bbb6-3b38d4fad7b7 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:24.466713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe079570-2dff-4374-bbb6-3b38d4fad7b7 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:24.471525 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330d400-dacf-4624-b031-af7c6d2708cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:24.472425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330d400-dacf-4624-b031-af7c6d2708cb admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:24.472870 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330d400-dacf-4624-b031-af7c6d2708cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:24.473292 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330d400-dacf-4624-b031-af7c6d2708cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:24.474124 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330d400-dacf-4624-b031-af7c6d2708cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:24.476312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330d400-dacf-4624-b031-af7c6d2708cb admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:24.523483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1335/2664] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:44:24 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:44:24.528078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e4ff7-ec71-4ae0-ac24-a3db1f8c498d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:24.538829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e4ff7-ec71-4ae0-ac24-a3db1f8c498d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:24.594361 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857026a-d78a-47c3-8d44-147d472a2864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:24.595074 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857026a-d78a-47c3-8d44-147d472a2864 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:24.595354 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857026a-d78a-47c3-8d44-147d472a2864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:24.595628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857026a-d78a-47c3-8d44-147d472a2864 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:24.596356 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857026a-d78a-47c3-8d44-147d472a2864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:24.598269 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857026a-d78a-47c3-8d44-147d472a2864 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:24.618786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1330/2665] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:44:24 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:44:24.622809 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330d400-dacf-4624-b031-af7c6d2708cb admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:24.633559 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330d400-dacf-4624-b031-af7c6d2708cb admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:24.641075 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e068c8-9248-43b6-b9a4-51fa95258ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:24.641909 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e068c8-9248-43b6-b9a4-51fa95258ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:24.642197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e068c8-9248-43b6-b9a4-51fa95258ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:24.642472 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e068c8-9248-43b6-b9a4-51fa95258ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:24.643244 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e068c8-9248-43b6-b9a4-51fa95258ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:24.644882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e068c8-9248-43b6-b9a4-51fa95258ddd admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:24.656199 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1336/2666] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:44:24.660310 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857026a-d78a-47c3-8d44-147d472a2864 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:24.670355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857026a-d78a-47c3-8d44-147d472a2864 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:24.675127 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c48d2-ef2d-4c12-b6e8-12e68ac67df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:24.676019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c48d2-ef2d-4c12-b6e8-12e68ac67df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:24.676293 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c48d2-ef2d-4c12-b6e8-12e68ac67df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:24.676558 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c48d2-ef2d-4c12-b6e8-12e68ac67df3 admin admin] PATH_INFO: `/v3/projects/03ff76db0e6a4bafa228ad0a4575d3e3/users/3e017c7f6d964194934cc8e8e1d16328/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:24.691653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c48d2-ef2d-4c12-b6e8-12e68ac67df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ff76db0e6a4bafa228ad0a4575d3e3, user_id=3e017c7f6d964194934cc8e8e1d16328, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:24.694515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c48d2-ef2d-4c12-b6e8-12e68ac67df3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:24.708144 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1331/2667] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:44:24 2022] PUT /identity/v3/projects/03ff76db0e6a4bafa228ad0a4575d3e3/users/3e017c7f6d964194934cc8e8e1d16328/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:44:24.712301 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e068c8-9248-43b6-b9a4-51fa95258ddd admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:24.724551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e068c8-9248-43b6-b9a4-51fa95258ddd admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:24.819488 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a33bd-9134-4296-a2cd-1e5dcf0e19ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:24.823502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a33bd-9134-4296-a2cd-1e5dcf0e19ee admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:24.823736 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a33bd-9134-4296-a2cd-1e5dcf0e19ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:24.824014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a33bd-9134-4296-a2cd-1e5dcf0e19ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:24.824765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a33bd-9134-4296-a2cd-1e5dcf0e19ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:24.826403 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a33bd-9134-4296-a2cd-1e5dcf0e19ee admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:24.836885 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1337/2668] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:44:24.843172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c48d2-ef2d-4c12-b6e8-12e68ac67df3 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:24.857892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c48d2-ef2d-4c12-b6e8-12e68ac67df3 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:24.868433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26ca43-3e10-4bdd-ad11-5d20248e8874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:24.869340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ca43-3e10-4bdd-ad11-5d20248e8874 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:24.870164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ca43-3e10-4bdd-ad11-5d20248e8874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:24.870434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ca43-3e10-4bdd-ad11-5d20248e8874 admin admin] PATH_INFO: `/v3/projects/03ff76db0e6a4bafa228ad0a4575d3e3/users/3e017c7f6d964194934cc8e8e1d16328/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:24.872486 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26ca43-3e10-4bdd-ad11-5d20248e8874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ff76db0e6a4bafa228ad0a4575d3e3, user_id=3e017c7f6d964194934cc8e8e1d16328, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:24.875433 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26ca43-3e10-4bdd-ad11-5d20248e8874 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:24.892268 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1332/2669] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:44:24 2022] PUT /identity/v3/projects/03ff76db0e6a4bafa228ad0a4575d3e3/users/3e017c7f6d964194934cc8e8e1d16328/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:44:26.974680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a33bd-9134-4296-a2cd-1e5dcf0e19ee admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:27.063852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a33bd-9134-4296-a2cd-1e5dcf0e19ee admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:27.144894 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce17bc8-b166-424b-863c-eb91ff20977a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:27.146387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce17bc8-b166-424b-863c-eb91ff20977a service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:27.146387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce17bc8-b166-424b-863c-eb91ff20977a service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:27.146596 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce17bc8-b166-424b-863c-eb91ff20977a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:27.149286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7ce17bc8-b166-424b-863c-eb91ff20977a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:27.160447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce17bc8-b166-424b-863c-eb91ff20977a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:27.162200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce17bc8-b166-424b-863c-eb91ff20977a service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:27.179591 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1338/2670] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:44:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:44:29.690643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ecee-9cdc-42dd-aed2-bb0291b649bd None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:29.691225 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ecee-9cdc-42dd-aed2-bb0291b649bd None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:29.691225 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ecee-9cdc-42dd-aed2-bb0291b649bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:29.723168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-0d06ecee-9cdc-42dd-aed2-bb0291b649bd None None] MFA Rules not processed for user `3e017c7f6d964194934cc8e8e1d16328`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:29.724844 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-0d06ecee-9cdc-42dd-aed2-bb0291b649bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:29.821252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1333/2671] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:29.839567 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce17bc8-b166-424b-863c-eb91ff20977a service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:29.845776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7ce17bc8-b166-424b-863c-eb91ff20977a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:29.930046 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce17bc8-b166-424b-863c-eb91ff20977a service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:29.935145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919d7d2-4051-40f6-b5a3-dfe1f0fb2b97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ad61a348b2450baceb030f98150647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:29.937861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919d7d2-4051-40f6-b5a3-dfe1f0fb2b97 service glance] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:29.938343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919d7d2-4051-40f6-b5a3-dfe1f0fb2b97 service glance] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:29.938813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919d7d2-4051-40f6-b5a3-dfe1f0fb2b97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:30.012256 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919d7d2-4051-40f6-b5a3-dfe1f0fb2b97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:30.014610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919d7d2-4051-40f6-b5a3-dfe1f0fb2b97 service glance] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:30.032780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1339/2672] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:44:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:44:30.190975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae727-8b39-4525-9534-e9c14092140c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:30.191533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae727-8b39-4525-9534-e9c14092140c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:30.191959 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae727-8b39-4525-9534-e9c14092140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:30.211060 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-3ebae727-8b39-4525-9534-e9c14092140c None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:30.212519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3ebae727-8b39-4525-9534-e9c14092140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:30.305249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1334/2673] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:44:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:30.310262 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919d7d2-4051-40f6-b5a3-dfe1f0fb2b97 service glance] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:30.313478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2919d7d2-4051-40f6-b5a3-dfe1f0fb2b97 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:30.475995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919d7d2-4051-40f6-b5a3-dfe1f0fb2b97 service glance] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:30.482243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5d17b-8e05-4b62-95a1-7a4c94f7ab00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:30.482917 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5d17b-8e05-4b62-95a1-7a4c94f7ab00 service swift] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:30.483223 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5d17b-8e05-4b62-95a1-7a4c94f7ab00 service swift] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:30.483500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5d17b-8e05-4b62-95a1-7a4c94f7ab00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:30.492500 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5d17b-8e05-4b62-95a1-7a4c94f7ab00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:30.494085 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5d17b-8e05-4b62-95a1-7a4c94f7ab00 service swift] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:30.503660 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1340/2674] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:44:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:44:40.459966 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e80c4-08fb-4387-b15f-c529e6413888 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:40.460474 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e80c4-08fb-4387-b15f-c529e6413888 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:40.460574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e80c4-08fb-4387-b15f-c529e6413888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:40.479602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-626e80c4-08fb-4387-b15f-c529e6413888 None None] MFA Rules not processed for user `1427c81157ea4c7db763a51954a7e865`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:40.480769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-626e80c4-08fb-4387-b15f-c529e6413888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:40.488400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1335/2675] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:42.285624 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bcfdb-6048-428a-b25e-993ca690c196 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:42.286154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bcfdb-6048-428a-b25e-993ca690c196 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:42.286365 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bcfdb-6048-428a-b25e-993ca690c196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:42.305917 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-9c7bcfdb-6048-428a-b25e-993ca690c196 None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:44:42.307722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-9c7bcfdb-6048-428a-b25e-993ca690c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:42.314805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1341/2676] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:44:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:44:42.326869 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e80c4-08fb-4387-b15f-c529e6413888 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:42.338737 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e80c4-08fb-4387-b15f-c529e6413888 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:42.343712 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1e3e0-45b0-49d4-b8bc-d6f555f81263 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:42.344449 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1e3e0-45b0-49d4-b8bc-d6f555f81263 service swift] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:42.344801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1e3e0-45b0-49d4-b8bc-d6f555f81263 service swift] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:42.345139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1e3e0-45b0-49d4-b8bc-d6f555f81263 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:42.354226 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1e3e0-45b0-49d4-b8bc-d6f555f81263 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:42.355823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1e3e0-45b0-49d4-b8bc-d6f555f81263 service swift] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:42.363715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1336/2677] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:44:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:44:57.299975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bcfdb-6048-428a-b25e-993ca690c196 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:57.309648 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bcfdb-6048-428a-b25e-993ca690c196 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:57.313077 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4247e-9e77-4c90-b388-971620cc3c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:57.313743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4247e-9e77-4c90-b388-971620cc3c05 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:57.314020 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4247e-9e77-4c90-b388-971620cc3c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:57.314286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4247e-9e77-4c90-b388-971620cc3c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:57.316012 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-1fa4247e-9e77-4c90-b388-971620cc3c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:57.376106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4247e-9e77-4c90-b388-971620cc3c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:57.377543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4247e-9e77-4c90-b388-971620cc3c05 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:57.387091 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1342/2678] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:44:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:44:59.495208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1e3e0-45b0-49d4-b8bc-d6f555f81263 service swift] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:59.496694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-92b1e3e0-45b0-49d4-b8bc-d6f555f81263 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:59.566594 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1e3e0-45b0-49d4-b8bc-d6f555f81263 service swift] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:59.572187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499ef1b-aaee-4006-ab58-0156d884ad10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:59.572820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499ef1b-aaee-4006-ab58-0156d884ad10 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:59.573096 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499ef1b-aaee-4006-ab58-0156d884ad10 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:59.573368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499ef1b-aaee-4006-ab58-0156d884ad10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:59.575148 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6499ef1b-aaee-4006-ab58-0156d884ad10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:59.587252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499ef1b-aaee-4006-ab58-0156d884ad10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:59.588818 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499ef1b-aaee-4006-ab58-0156d884ad10 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:59.599277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1337/2679] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:44:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:45:11.927210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a57231-6c57-4e7b-8d72-148a4c8d51ea None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:11.927627 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a57231-6c57-4e7b-8d72-148a4c8d51ea None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:11.927966 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a57231-6c57-4e7b-8d72-148a4c8d51ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:11.946063 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-b2a57231-6c57-4e7b-8d72-148a4c8d51ea None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:45:11.947199 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-b2a57231-6c57-4e7b-8d72-148a4c8d51ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:45:11.954152 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1343/2680] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:45:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:45:11.967466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499ef1b-aaee-4006-ab58-0156d884ad10 service nova] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:45:11.979727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499ef1b-aaee-4006-ab58-0156d884ad10 service nova] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:45:11.984600 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cd752-64d1-4059-bdb5-bb1535e5db73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:45:11.985221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd752-64d1-4059-bdb5-bb1535e5db73 service swift] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:11.985497 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd752-64d1-4059-bdb5-bb1535e5db73 service swift] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:11.985769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd752-64d1-4059-bdb5-bb1535e5db73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:11.993602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cd752-64d1-4059-bdb5-bb1535e5db73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:45:11.995177 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cd752-64d1-4059-bdb5-bb1535e5db73 service swift] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:45:12.002830 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1338/2681] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:45:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:45:17.575312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a57231-6c57-4e7b-8d72-148a4c8d51ea None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:45:17.593023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a57231-6c57-4e7b-8d72-148a4c8d51ea None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:45:17.596739 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf8a8d-5de2-416c-8b31-9fba42748a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:45:17.597449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8a8d-5de2-416c-8b31-9fba42748a4c service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:17.597729 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8a8d-5de2-416c-8b31-9fba42748a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:17.598231 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8a8d-5de2-416c-8b31-9fba42748a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:17.609622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf8a8d-5de2-416c-8b31-9fba42748a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:45:17.611713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf8a8d-5de2-416c-8b31-9fba42748a4c service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:45:17.623727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1344/2682] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:45:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:45:26.617215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f727b5-5e9c-4398-ab26-ab9caa24c4b5 None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:26.618349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f727b5-5e9c-4398-ab26-ab9caa24c4b5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:26.618465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f727b5-5e9c-4398-ab26-ab9caa24c4b5 None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:26.620358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1339/2683] 10.222.0.44 () {54 vars in 921 bytes} [Mon Feb 28 10:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:45:26.626441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74ffd3-6ea7-4bb0-9669-e1ce9d8fa65f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:26.626969 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74ffd3-6ea7-4bb0-9669-e1ce9d8fa65f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:26.627127 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74ffd3-6ea7-4bb0-9669-e1ce9d8fa65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:26.663149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-9d74ffd3-6ea7-4bb0-9669-e1ce9d8fa65f None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:45:26.664442 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-9d74ffd3-6ea7-4bb0-9669-e1ce9d8fa65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:45:26.673614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1345/2684] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Feb 28 10:45:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:45:26.685469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f727b5-5e9c-4398-ab26-ab9caa24c4b5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:45:26.696719 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f727b5-5e9c-4398-ab26-ab9caa24c4b5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:45:26.700166 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f12a8-0fce-43f8-b28e-23bd298a8f8b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ad61a348b2450baceb030f98150647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:45:26.700791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f12a8-0fce-43f8-b28e-23bd298a8f8b service glance] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:26.701064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f12a8-0fce-43f8-b28e-23bd298a8f8b service glance] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:26.701331 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f12a8-0fce-43f8-b28e-23bd298a8f8b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:26.712937 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f12a8-0fce-43f8-b28e-23bd298a8f8b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:45:26.714354 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f12a8-0fce-43f8-b28e-23bd298a8f8b service glance] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:45:26.725025 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1340/2685] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:45:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:45:26.790042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80f6dd-c282-4058-8d78-46972fe8809c None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:26.790328 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80f6dd-c282-4058-8d78-46972fe8809c None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:26.790888 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80f6dd-c282-4058-8d78-46972fe8809c None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:26.792858 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1346/2686] 10.222.0.44 () {54 vars in 921 bytes} [Mon Feb 28 10:45:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:45:26.797718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a66b-926e-444d-a167-69867562cb53 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:26.797992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a66b-926e-444d-a167-69867562cb53 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:26.798262 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a66b-926e-444d-a167-69867562cb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:26.816402 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-3022a66b-926e-444d-a167-69867562cb53 None None] MFA Rules not processed for user `44fb3491570c41cbb7271cfce1c31e39`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:45:26.817567 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-3022a66b-926e-444d-a167-69867562cb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:45:26.824264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1341/2687] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Feb 28 10:45:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:45:26.835636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80f6dd-c282-4058-8d78-46972fe8809c None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:45:26.837807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-1c80f6dd-c282-4058-8d78-46972fe8809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:45:26.850665 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80f6dd-c282-4058-8d78-46972fe8809c None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:45:26.854829 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000a900-4b8a-4555-95d3-fc0172d00542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:45:26.855475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000a900-4b8a-4555-95d3-fc0172d00542 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:26.855757 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000a900-4b8a-4555-95d3-fc0172d00542 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:26.856032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000a900-4b8a-4555-95d3-fc0172d00542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:26.862881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000a900-4b8a-4555-95d3-fc0172d00542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:45:26.864315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000a900-4b8a-4555-95d3-fc0172d00542 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:45:26.871810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1347/2688] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:45:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:45:26.957846 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caa0a9-15ac-4b71-a998-dc0b41e232bd None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:26.958152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caa0a9-15ac-4b71-a998-dc0b41e232bd None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:26.958425 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caa0a9-15ac-4b71-a998-dc0b41e232bd None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:26.960264 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1342/2689] 10.222.0.44 () {54 vars in 921 bytes} [Mon Feb 28 10:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:45:26.966153 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30fd13-c5a6-46f8-8351-05c288ffdfc9 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:26.966437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30fd13-c5a6-46f8-8351-05c288ffdfc9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:26.966710 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30fd13-c5a6-46f8-8351-05c288ffdfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:26.985045 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-6b30fd13-c5a6-46f8-8351-05c288ffdfc9 None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:45:26.986215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-6b30fd13-c5a6-46f8-8351-05c288ffdfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:45:26.995251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1348/2690] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Feb 28 10:45:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:45:27.005546 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caa0a9-15ac-4b71-a998-dc0b41e232bd None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:45:27.017013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caa0a9-15ac-4b71-a998-dc0b41e232bd None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:45:27.020518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043f659-bafe-4290-8341-3577c6982558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:45:27.021122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043f659-bafe-4290-8341-3577c6982558 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:27.021394 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043f659-bafe-4290-8341-3577c6982558 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:27.021661 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043f659-bafe-4290-8341-3577c6982558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:27.031935 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043f659-bafe-4290-8341-3577c6982558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:45:27.033337 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043f659-bafe-4290-8341-3577c6982558 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:45:27.043469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1343/2691] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:45:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:45:28.746974 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754a3f3-31fc-4626-a1cc-5d7036674e18 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:28.747431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754a3f3-31fc-4626-a1cc-5d7036674e18 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:28.747534 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754a3f3-31fc-4626-a1cc-5d7036674e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:28.765325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c754a3f3-31fc-4626-a1cc-5d7036674e18 None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:45:28.766495 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c754a3f3-31fc-4626-a1cc-5d7036674e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:45:28.774177 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1349/2692] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Feb 28 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:45:28.786078 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043f659-bafe-4290-8341-3577c6982558 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:45:28.797097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043f659-bafe-4290-8341-3577c6982558 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:45:28.801949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065c96c-8fcc-4d89-b263-7eb9024e9a97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:45:28.802568 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065c96c-8fcc-4d89-b263-7eb9024e9a97 service swift] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:28.802841 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065c96c-8fcc-4d89-b263-7eb9024e9a97 service swift] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:28.803137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065c96c-8fcc-4d89-b263-7eb9024e9a97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:28.810918 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065c96c-8fcc-4d89-b263-7eb9024e9a97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:45:28.812488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065c96c-8fcc-4d89-b263-7eb9024e9a97 service swift] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:45:28.820888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1344/2693] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:45:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:45:49.216986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05d071-aa12-4192-949d-03ca49f3afd7 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:49.217637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05d071-aa12-4192-949d-03ca49f3afd7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:49.217637 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05d071-aa12-4192-949d-03ca49f3afd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:49.234563 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-5c05d071-aa12-4192-949d-03ca49f3afd7 None None] MFA Rules not processed for user `9e3ca0cfe4ad49bd90027a7ea95bf024`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:45:49.235787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5c05d071-aa12-4192-949d-03ca49f3afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:45:49.288768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1350/2694] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:45:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:45:49.614413 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065c96c-8fcc-4d89-b263-7eb9024e9a97 service swift] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:45:49.624371 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065c96c-8fcc-4d89-b263-7eb9024e9a97 service swift] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:45:49.627941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc3493-8c9f-4c26-a441-a7e485787ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:45:49.628565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc3493-8c9f-4c26-a441-a7e485787ccd service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:49.628834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc3493-8c9f-4c26-a441-a7e485787ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:49.629097 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc3493-8c9f-4c26-a441-a7e485787ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:49.631141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-70dc3493-8c9f-4c26-a441-a7e485787ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:45:49.640642 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc3493-8c9f-4c26-a441-a7e485787ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:45:49.642122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc3493-8c9f-4c26-a441-a7e485787ccd service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:45:49.650040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1345/2695] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:45:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:45:51.476191 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb293-5973-4cdd-b6d3-957797252294 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:51.476760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb293-5973-4cdd-b6d3-957797252294 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:51.476855 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb293-5973-4cdd-b6d3-957797252294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:51.496880 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-7b3eb293-5973-4cdd-b6d3-957797252294 None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:45:51.498665 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7b3eb293-5973-4cdd-b6d3-957797252294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:45:51.507622 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1351/2696] 10.222.0.44 () {58 vars in 967 bytes} [Mon Feb 28 10:45:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:45:51.520603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc3493-8c9f-4c26-a441-a7e485787ccd service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:45:51.535712 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc3493-8c9f-4c26-a441-a7e485787ccd service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:45:51.542006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843fd6b-f995-4394-b898-915588948390 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:45:51.542651 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843fd6b-f995-4394-b898-915588948390 service swift] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:51.542938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843fd6b-f995-4394-b898-915588948390 service swift] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:51.543254 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843fd6b-f995-4394-b898-915588948390 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:51.552688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843fd6b-f995-4394-b898-915588948390 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:45:51.554313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843fd6b-f995-4394-b898-915588948390 service swift] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:45:51.563149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1346/2697] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:45:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:47:04.370983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb293-5973-4cdd-b6d3-957797252294 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:04.380352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb293-5973-4cdd-b6d3-957797252294 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:04.384370 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ad78d-a2d9-4863-bb6d-976edd2b0b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:04.384990 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ad78d-a2d9-4863-bb6d-976edd2b0b37 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:04.385266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ad78d-a2d9-4863-bb6d-976edd2b0b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:04.385537 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ad78d-a2d9-4863-bb6d-976edd2b0b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:04.387248 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c66ad78d-a2d9-4863-bb6d-976edd2b0b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:04.447028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ad78d-a2d9-4863-bb6d-976edd2b0b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:04.448432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ad78d-a2d9-4863-bb6d-976edd2b0b37 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:04.457811 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1352/2698] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:47:05.513573 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843fd6b-f995-4394-b898-915588948390 service swift] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:05.515017 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d843fd6b-f995-4394-b898-915588948390 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:05.581221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843fd6b-f995-4394-b898-915588948390 service swift] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:05.586984 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54992f-ba1d-410c-8b3b-f9dd6d04c55c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee30c8013ebb40a99d1eac7820d7f1f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:05.587634 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54992f-ba1d-410c-8b3b-f9dd6d04c55c service placement] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:05.587982 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54992f-ba1d-410c-8b3b-f9dd6d04c55c service placement] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:05.588260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54992f-ba1d-410c-8b3b-f9dd6d04c55c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:05.590024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ac54992f-ba1d-410c-8b3b-f9dd6d04c55c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:05.603141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54992f-ba1d-410c-8b3b-f9dd6d04c55c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:05.604710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54992f-ba1d-410c-8b3b-f9dd6d04c55c service placement] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:05.614588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1347/2699] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:47:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:47:07.846805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ad78d-a2d9-4863-bb6d-976edd2b0b37 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:07.849356 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c66ad78d-a2d9-4863-bb6d-976edd2b0b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:07.878838 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ad78d-a2d9-4863-bb6d-976edd2b0b37 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:07.884773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b0b86-ed79-44ea-ae23-d9a809847ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:07.885654 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b0b86-ed79-44ea-ae23-d9a809847ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:07.885934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b0b86-ed79-44ea-ae23-d9a809847ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:07.886202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b0b86-ed79-44ea-ae23-d9a809847ff0 admin admin] PATH_INFO: `/v3/users/e8a15e844eba4dd8864ff1fe152d9d63` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:07.887543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b0b86-ed79-44ea-ae23-d9a809847ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a15e844eba4dd8864ff1fe152d9d63)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:07.889446 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b0b86-ed79-44ea-ae23-d9a809847ff0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:07.933641 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ab0b0b86-ed79-44ea-ae23-d9a809847ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a15e844eba4dd8864ff1fe152d9d63'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:47:07.934287 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ab0b0b86-ed79-44ea-ae23-d9a809847ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a15e844eba4dd8864ff1fe152d9d63'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:47:07.934884 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ab0b0b86-ed79-44ea-ae23-d9a809847ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a15e844eba4dd8864ff1fe152d9d63'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:47:07.946550 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ab0b0b86-ed79-44ea-ae23-d9a809847ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a15e844eba4dd8864ff1fe152d9d63'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:47:07.953610 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ab0b0b86-ed79-44ea-ae23-d9a809847ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a15e844eba4dd8864ff1fe152d9d63'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:47:07.965633 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1353/2700] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:47:07 2022] DELETE /identity/v3/users/e8a15e844eba4dd8864ff1fe152d9d63 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:47:08.132038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54992f-ba1d-410c-8b3b-f9dd6d04c55c service placement] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:08.143277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54992f-ba1d-410c-8b3b-f9dd6d04c55c service placement] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:08.198345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:08.199273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:08.199522 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:08.199814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] PATH_INFO: `/v3/projects/6825cb4cea9e4921b5312dd51b9920be` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:08.201038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6825cb4cea9e4921b5312dd51b9920be)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:08.202921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:08.245521 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6825cb4cea9e4921b5312dd51b9920be', 'request_id': 'req-34a4913b-a92e-4289-97b4-b1c441b8e778'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:47:08.250631 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6825cb4cea9e4921b5312dd51b9920be', 'request_id': 'req-34a4913b-a92e-4289-97b4-b1c441b8e778'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:47:08.256683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6825cb4cea9e4921b5312dd51b9920be', 'request_id': 'req-34a4913b-a92e-4289-97b4-b1c441b8e778'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:47:08.268626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] The token cache is being invalidate because project 6825cb4cea9e4921b5312dd51b9920be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:47:08.268852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:47:08.269476 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-34a4913b-a92e-4289-97b4-b1c441b8e778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:47:08.270989 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1348/2701] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:47:08 2022] DELETE /identity/v3/projects/6825cb4cea9e4921b5312dd51b9920be => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:47:08.276468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cece8-2a54-4114-a1dc-0864489ae0c3 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:08.276764 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cece8-2a54-4114-a1dc-0864489ae0c3 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:08.277043 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cece8-2a54-4114-a1dc-0864489ae0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:08.295562 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-ed1cece8-2a54-4114-a1dc-0864489ae0c3 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:47:08.296777 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ed1cece8-2a54-4114-a1dc-0864489ae0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:08.352933 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1354/2702] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:47:08.361277 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f723-6f17-4d7a-8b75-79c2d8d9becb None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:08.361562 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f723-6f17-4d7a-8b75-79c2d8d9becb None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:08.361835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f723-6f17-4d7a-8b75-79c2d8d9becb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:08.379965 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-d420f723-6f17-4d7a-8b75-79c2d8d9becb None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:47:08.381151 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-d420f723-6f17-4d7a-8b75-79c2d8d9becb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:08.389430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1349/2703] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:47:08.393552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cece8-2a54-4114-a1dc-0864489ae0c3 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:08.403464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cece8-2a54-4114-a1dc-0864489ae0c3 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:08.407917 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df203360-d7e2-43cb-93d7-c7884ae6fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:08.408552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df203360-d7e2-43cb-93d7-c7884ae6fb26 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:08.408826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df203360-d7e2-43cb-93d7-c7884ae6fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:08.409096 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df203360-d7e2-43cb-93d7-c7884ae6fb26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:08.409796 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df203360-d7e2-43cb-93d7-c7884ae6fb26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:47:08.410093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df203360-d7e2-43cb-93d7-c7884ae6fb26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:08.411692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df203360-d7e2-43cb-93d7-c7884ae6fb26 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:08.422674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1355/2704] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:47:08.426718 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420f723-6f17-4d7a-8b75-79c2d8d9becb None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:08.435612 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420f723-6f17-4d7a-8b75-79c2d8d9becb None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:08.440186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647a5b0-91a6-4e72-9b01-07369dd1ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:08.440809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a5b0-91a6-4e72-9b01-07369dd1ad7a admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:08.441086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a5b0-91a6-4e72-9b01-07369dd1ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:08.441355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a5b0-91a6-4e72-9b01-07369dd1ad7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:08.442038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647a5b0-91a6-4e72-9b01-07369dd1ad7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:08.443940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647a5b0-91a6-4e72-9b01-07369dd1ad7a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:08.469313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1350/2705] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:47:08 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:47:08.473414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df203360-d7e2-43cb-93d7-c7884ae6fb26 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:08.483257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df203360-d7e2-43cb-93d7-c7884ae6fb26 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:08.537520 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f830a4-2669-46ad-b725-fe930bb5603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:08.538130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f830a4-2669-46ad-b725-fe930bb5603c admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:08.538419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f830a4-2669-46ad-b725-fe930bb5603c admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:08.538689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f830a4-2669-46ad-b725-fe930bb5603c admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:08.539402 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f830a4-2669-46ad-b725-fe930bb5603c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:08.541291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f830a4-2669-46ad-b725-fe930bb5603c admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:08.560490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1356/2706] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:47:08 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:47:08.564469 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647a5b0-91a6-4e72-9b01-07369dd1ad7a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:08.574924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647a5b0-91a6-4e72-9b01-07369dd1ad7a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:08.579476 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80602002-a540-4739-84ed-abc55947cc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:08.580120 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80602002-a540-4739-84ed-abc55947cc23 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:08.580396 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80602002-a540-4739-84ed-abc55947cc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:08.580667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80602002-a540-4739-84ed-abc55947cc23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:08.581379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80602002-a540-4739-84ed-abc55947cc23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:08.583006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80602002-a540-4739-84ed-abc55947cc23 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:08.592921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1351/2707] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:47:08.596683 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f830a4-2669-46ad-b725-fe930bb5603c admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:08.606514 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f830a4-2669-46ad-b725-fe930bb5603c admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:08.611090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25e3b3-9beb-41a6-b613-ce97cb32d867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:08.611726 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25e3b3-9beb-41a6-b613-ce97cb32d867 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:08.612032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25e3b3-9beb-41a6-b613-ce97cb32d867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:08.612304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25e3b3-9beb-41a6-b613-ce97cb32d867 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:08.613009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25e3b3-9beb-41a6-b613-ce97cb32d867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:08.614730 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25e3b3-9beb-41a6-b613-ce97cb32d867 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:08.624754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1357/2708] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:47:08.628940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80602002-a540-4739-84ed-abc55947cc23 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:08.639034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80602002-a540-4739-84ed-abc55947cc23 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:08.643489 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a01992-29d4-402e-84c2-f51e14a2a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:08.644335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a01992-29d4-402e-84c2-f51e14a2a71d admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:08.644604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a01992-29d4-402e-84c2-f51e14a2a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:08.644863 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a01992-29d4-402e-84c2-f51e14a2a71d admin admin] PATH_INFO: `/v3/projects/062b83dd1ce5429eb5e1cd526c5d3360/users/34ee2098769f4de4afc4dd5f989e90b4/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:08.658614 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a01992-29d4-402e-84c2-f51e14a2a71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=062b83dd1ce5429eb5e1cd526c5d3360, user_id=34ee2098769f4de4afc4dd5f989e90b4, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:08.661243 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a01992-29d4-402e-84c2-f51e14a2a71d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:08.674949 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1352/2709] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:47:08 2022] PUT /identity/v3/projects/062b83dd1ce5429eb5e1cd526c5d3360/users/34ee2098769f4de4afc4dd5f989e90b4/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:47:08.680529 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1de3a-3ae1-482c-992d-497c9f14ba07 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:08.680815 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1de3a-3ae1-482c-992d-497c9f14ba07 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:08.681089 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1de3a-3ae1-482c-992d-497c9f14ba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:08.698764 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-cad1de3a-3ae1-482c-992d-497c9f14ba07 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:47:08.699967 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-cad1de3a-3ae1-482c-992d-497c9f14ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:08.756049 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1358/2710] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:47:08.766160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a01992-29d4-402e-84c2-f51e14a2a71d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:08.767834 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-34a01992-29d4-402e-84c2-f51e14a2a71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:08.824520 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a01992-29d4-402e-84c2-f51e14a2a71d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:08.828252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b31ed-4818-4b5d-a086-d42b5fadc857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:08.828942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b31ed-4818-4b5d-a086-d42b5fadc857 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:08.829221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b31ed-4818-4b5d-a086-d42b5fadc857 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:08.829492 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b31ed-4818-4b5d-a086-d42b5fadc857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:08.838666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b31ed-4818-4b5d-a086-d42b5fadc857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:08.840121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b31ed-4818-4b5d-a086-d42b5fadc857 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:08.849397 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1353/2711] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:47:12.712552 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486dd4-f08c-4e95-9a8c-9d38707fc40d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:12.713067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486dd4-f08c-4e95-9a8c-9d38707fc40d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:12.713181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486dd4-f08c-4e95-9a8c-9d38707fc40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:12.740532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-80486dd4-f08c-4e95-9a8c-9d38707fc40d None None] MFA Rules not processed for user `34ee2098769f4de4afc4dd5f989e90b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:47:12.742379 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-80486dd4-f08c-4e95-9a8c-9d38707fc40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:12.815159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1359/2712] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:47:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:47:12.830170 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b31ed-4818-4b5d-a086-d42b5fadc857 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:12.833342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-828b31ed-4818-4b5d-a086-d42b5fadc857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:12.918001 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b31ed-4818-4b5d-a086-d42b5fadc857 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:12.923929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf933-99c0-4305-9df0-36f0af6e0d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:12.924715 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf933-99c0-4305-9df0-36f0af6e0d39 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:12.925242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf933-99c0-4305-9df0-36f0af6e0d39 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:12.925617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf933-99c0-4305-9df0-36f0af6e0d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:12.934544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf933-99c0-4305-9df0-36f0af6e0d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:12.936336 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf933-99c0-4305-9df0-36f0af6e0d39 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:12.947503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1354/2713] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:47:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:47:14.551528 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9acc0-c8f2-40e6-b4ad-58d1450efa5b None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:14.552055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9acc0-c8f2-40e6-b4ad-58d1450efa5b None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:14.552055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9acc0-c8f2-40e6-b4ad-58d1450efa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:14.570411 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-9af9acc0-c8f2-40e6-b4ad-58d1450efa5b None None] MFA Rules not processed for user `34ee2098769f4de4afc4dd5f989e90b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:47:14.571664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-9af9acc0-c8f2-40e6-b4ad-58d1450efa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:14.578978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1360/2714] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:47:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:47:41.194739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b34df6-f993-4899-aaf3-feed427c8d5a None None] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:41.195368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b34df6-f993-4899-aaf3-feed427c8d5a None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:41.195368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b34df6-f993-4899-aaf3-feed427c8d5a None None] PATH_INFO: `/` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:41.197291 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1355/2715] 10.222.0.44 () {54 vars in 921 bytes} [Mon Feb 28 10:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:47:41.203409 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0a199-d9b9-42a7-95bc-03be906fc026 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:41.203899 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0a199-d9b9-42a7-95bc-03be906fc026 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:41.204095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0a199-d9b9-42a7-95bc-03be906fc026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:41.222846 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-aad0a199-d9b9-42a7-95bc-03be906fc026 None None] MFA Rules not processed for user `44fb3491570c41cbb7271cfce1c31e39`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:47:41.224166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-aad0a199-d9b9-42a7-95bc-03be906fc026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:41.230976 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1361/2716] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Feb 28 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:47:41.242582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b34df6-f993-4899-aaf3-feed427c8d5a None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:41.244395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b9b34df6-f993-4899-aaf3-feed427c8d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:41.258604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b34df6-f993-4899-aaf3-feed427c8d5a None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:41.262282 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de621e2-7dee-4563-b19e-02c65a662fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:41.262971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de621e2-7dee-4563-b19e-02c65a662fcc service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:41.263250 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de621e2-7dee-4563-b19e-02c65a662fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:41.263518 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de621e2-7dee-4563-b19e-02c65a662fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:41.270845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de621e2-7dee-4563-b19e-02c65a662fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:41.272941 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de621e2-7dee-4563-b19e-02c65a662fcc service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:41.281021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1356/2717] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:47:41.387018 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c331d7-c618-42c0-a7f1-2e3c93f65e25 None None] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:41.387301 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c331d7-c618-42c0-a7f1-2e3c93f65e25 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:41.387570 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c331d7-c618-42c0-a7f1-2e3c93f65e25 None None] PATH_INFO: `/` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:41.389337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1362/2718] 10.222.0.44 () {54 vars in 921 bytes} [Mon Feb 28 10:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:47:41.394778 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ab6f-3e2f-49e0-881d-4461f6b90c3f None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:41.395102 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ab6f-3e2f-49e0-881d-4461f6b90c3f None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:41.395372 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ab6f-3e2f-49e0-881d-4461f6b90c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:41.413564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c803ab6f-3e2f-49e0-881d-4461f6b90c3f None None] MFA Rules not processed for user `b4132c15e66a4a619574f7aba10d6d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:47:41.414729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c803ab6f-3e2f-49e0-881d-4461f6b90c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:41.423727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1357/2719] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Feb 28 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:47:41.433650 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c331d7-c618-42c0-a7f1-2e3c93f65e25 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:41.444805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c331d7-c618-42c0-a7f1-2e3c93f65e25 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:47:41.448352 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2961b84-aa8b-427b-b17c-76f8618b002a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:47:41.448965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961b84-aa8b-427b-b17c-76f8618b002a service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:41.449243 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961b84-aa8b-427b-b17c-76f8618b002a service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:41.449514 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961b84-aa8b-427b-b17c-76f8618b002a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:41.459892 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2961b84-aa8b-427b-b17c-76f8618b002a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:47:41.461307 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2961b84-aa8b-427b-b17c-76f8618b002a service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:47:41.471677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1363/2720] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:47:59.828974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58158f1e-695a-4604-928b-4ec30c71f68e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:47:59.829405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58158f1e-695a-4604-928b-4ec30c71f68e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:47:59.829540 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58158f1e-695a-4604-928b-4ec30c71f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:47:59.848038 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-58158f1e-695a-4604-928b-4ec30c71f68e None None] MFA Rules not processed for user `642a67f2169944f29179e2a9a4f946b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:47:59.849189 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-58158f1e-695a-4604-928b-4ec30c71f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:47:59.901138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1358/2721] 10.222.0.44 () {58 vars in 967 bytes} [Mon Feb 28 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:47:59.948436 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2961b84-aa8b-427b-b17c-76f8618b002a service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:47:59.950324 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c2961b84-aa8b-427b-b17c-76f8618b002a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:00.016912 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2961b84-aa8b-427b-b17c-76f8618b002a service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:48:00.021716 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb548d5a-de61-44e3-bb5e-d593f8a62bfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6db1c2542943928de6132ec9e61c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:48:00.022339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb548d5a-de61-44e3-bb5e-d593f8a62bfd service swift] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:48:00.023249 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb548d5a-de61-44e3-bb5e-d593f8a62bfd service swift] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:48:00.023522 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb548d5a-de61-44e3-bb5e-d593f8a62bfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:48:00.031468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb548d5a-de61-44e3-bb5e-d593f8a62bfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:48:00.033014 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb548d5a-de61-44e3-bb5e-d593f8a62bfd service swift] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:48:00.040765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1364/2722] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Feb 28 10:47:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:48:06.670655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58158f1e-695a-4604-928b-4ec30c71f68e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:48:06.672388 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-58158f1e-695a-4604-928b-4ec30c71f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:06.687063 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58158f1e-695a-4604-928b-4ec30c71f68e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:48:06.692466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:48:06.693320 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:48:06.693588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:48:06.693848 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] PATH_INFO: `/v3/users/1427c81157ea4c7db763a51954a7e865` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:48:06.695587 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1427c81157ea4c7db763a51954a7e865)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:48:06.697504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:48:06.749750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1427c81157ea4c7db763a51954a7e865'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:06.750401 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1427c81157ea4c7db763a51954a7e865'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:06.762510 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1427c81157ea4c7db763a51954a7e865'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:06.769032 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1427c81157ea4c7db763a51954a7e865'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:06.776279 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1427c81157ea4c7db763a51954a7e865'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:06.782145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1359/2723] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:48:06 2022] DELETE /identity/v3/users/1427c81157ea4c7db763a51954a7e865 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:48:06.961249 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb548d5a-de61-44e3-bb5e-d593f8a62bfd service swift] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:48:06.976042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb548d5a-de61-44e3-bb5e-d593f8a62bfd service swift] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:48:07.034817 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:48:07.035689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:48:07.035965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:48:07.036236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] PATH_INFO: `/v3/projects/7199da134f5348a7adb55be7f0758efe` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:48:07.037399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7199da134f5348a7adb55be7f0758efe)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:48:07.039357 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:48:07.087154 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7199da134f5348a7adb55be7f0758efe', 'request_id': 'req-c4dfb5a2-a171-4260-9515-4809b775ac13'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.092385 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7199da134f5348a7adb55be7f0758efe', 'request_id': 'req-c4dfb5a2-a171-4260-9515-4809b775ac13'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.098315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7199da134f5348a7adb55be7f0758efe', 'request_id': 'req-c4dfb5a2-a171-4260-9515-4809b775ac13'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.111355 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] The token cache is being invalidate because project 7199da134f5348a7adb55be7f0758efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:48:07.111711 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.112396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.114575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1365/2724] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:48:06 2022] DELETE /identity/v3/projects/7199da134f5348a7adb55be7f0758efe => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:48:07.119150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:48:07.120512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:07.134873 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44004b17-f9e2-4389-bb20-bf14169b292a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:48:07.187559 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:48:07.188405 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:48:07.188683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:48:07.188952 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] PATH_INFO: `/v3/users/3e017c7f6d964194934cc8e8e1d16328` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:48:07.190108 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e017c7f6d964194934cc8e8e1d16328)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:48:07.192041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:48:07.234983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e017c7f6d964194934cc8e8e1d16328'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.235569 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e017c7f6d964194934cc8e8e1d16328'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.247548 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e017c7f6d964194934cc8e8e1d16328'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.255064 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e017c7f6d964194934cc8e8e1d16328'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.262149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e017c7f6d964194934cc8e8e1d16328'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.267842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1360/2725] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:48:07 2022] DELETE /identity/v3/users/3e017c7f6d964194934cc8e8e1d16328 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:48:07.440551 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:48:07.441989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:07.454393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfb5a2-a171-4260-9515-4809b775ac13 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:48:07.513166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:48:07.513916 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:48:07.514193 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:48:07.514464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] PATH_INFO: `/v3/projects/03ff76db0e6a4bafa228ad0a4575d3e3` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:48:07.515657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ff76db0e6a4bafa228ad0a4575d3e3)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:48:07.517543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:48:07.561170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ff76db0e6a4bafa228ad0a4575d3e3', 'request_id': 'req-d89f7e26-6c67-40a9-818d-aaac330914e9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.566566 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ff76db0e6a4bafa228ad0a4575d3e3', 'request_id': 'req-d89f7e26-6c67-40a9-818d-aaac330914e9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.572428 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ff76db0e6a4bafa228ad0a4575d3e3', 'request_id': 'req-d89f7e26-6c67-40a9-818d-aaac330914e9'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.583515 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] The token cache is being invalidate because project 03ff76db0e6a4bafa228ad0a4575d3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:48:07.583797 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.584403 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-d89f7e26-6c67-40a9-818d-aaac330914e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:48:07.585914 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1366/2726] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:48:07 2022] DELETE /identity/v3/projects/03ff76db0e6a4bafa228ad0a4575d3e3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:48:10.845268 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:48:10.846671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:10.901797 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9d256-0323-4de4-913c-cd9bee790714 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:48:10.946687 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6740826-e352-4904-b194-1b1afaacaaa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:48:10.947345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6740826-e352-4904-b194-1b1afaacaaa0 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:48:10.947623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6740826-e352-4904-b194-1b1afaacaaa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:48:10.947891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6740826-e352-4904-b194-1b1afaacaaa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:48:10.949626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b6740826-e352-4904-b194-1b1afaacaaa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:11.008910 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6740826-e352-4904-b194-1b1afaacaaa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:48:11.010316 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6740826-e352-4904-b194-1b1afaacaaa0 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:48:11.018945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1361/2727] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:48:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:48:21.921765 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea3b9e-0ce9-4fcd-83d7-701fc1c2cf8f None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:48:21.922234 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea3b9e-0ce9-4fcd-83d7-701fc1c2cf8f None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:48:21.922327 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea3b9e-0ce9-4fcd-83d7-701fc1c2cf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:48:21.939558 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-d3ea3b9e-0ce9-4fcd-83d7-701fc1c2cf8f None None] MFA Rules not processed for user `9e3ca0cfe4ad49bd90027a7ea95bf024`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:48:21.940742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d3ea3b9e-0ce9-4fcd-83d7-701fc1c2cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:21.947965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1367/2728] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:48:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:48:21.981141 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6740826-e352-4904-b194-1b1afaacaaa0 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:48:21.982503 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b6740826-e352-4904-b194-1b1afaacaaa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:21.993414 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6740826-e352-4904-b194-1b1afaacaaa0 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:48:21.996992 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cf793-9816-4422-b73c-787aec178471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:48:21.997613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf793-9816-4422-b73c-787aec178471 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:48:21.997890 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf793-9816-4422-b73c-787aec178471 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:48:21.998159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf793-9816-4422-b73c-787aec178471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:48:21.999884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-075cf793-9816-4422-b73c-787aec178471 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:22.066736 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cf793-9816-4422-b73c-787aec178471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:48:22.068172 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cf793-9816-4422-b73c-787aec178471 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:48:22.079504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1362/2729] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:48:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:48:22.800573 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea3b9e-0ce9-4fcd-83d7-701fc1c2cf8f None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:48:22.802028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-d3ea3b9e-0ce9-4fcd-83d7-701fc1c2cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:22.859643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea3b9e-0ce9-4fcd-83d7-701fc1c2cf8f None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:48:22.863182 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d964b00-3498-4a60-928f-a0d28d3299c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:48:22.863822 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d964b00-3498-4a60-928f-a0d28d3299c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:48:22.864101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d964b00-3498-4a60-928f-a0d28d3299c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:48:22.864378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d964b00-3498-4a60-928f-a0d28d3299c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:48:22.866298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5d964b00-3498-4a60-928f-a0d28d3299c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:22.880323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d964b00-3498-4a60-928f-a0d28d3299c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:48:22.881787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d964b00-3498-4a60-928f-a0d28d3299c3 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:48:22.893100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1368/2730] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:48:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:48:24.493080 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cf793-9816-4422-b73c-787aec178471 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:48:24.494551 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-075cf793-9816-4422-b73c-787aec178471 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:24.506926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cf793-9816-4422-b73c-787aec178471 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:48:24.510716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5af9bc-d5c4-4337-b542-393a057371f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:48:24.511409 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af9bc-d5c4-4337-b542-393a057371f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:48:24.511688 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af9bc-d5c4-4337-b542-393a057371f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:48:24.511962 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af9bc-d5c4-4337-b542-393a057371f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:48:24.513784 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-bd5af9bc-d5c4-4337-b542-393a057371f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:24.532628 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5af9bc-d5c4-4337-b542-393a057371f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:48:24.534205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5af9bc-d5c4-4337-b542-393a057371f8 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:48:24.547089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1363/2731] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:48:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:48:39.425892 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d964b00-3498-4a60-928f-a0d28d3299c3 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:48:39.434674 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d964b00-3498-4a60-928f-a0d28d3299c3 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:48:39.438232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7521e1-83ad-4b1f-8d1d-213cdda4d96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:48:39.438845 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7521e1-83ad-4b1f-8d1d-213cdda4d96a service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:48:39.439153 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7521e1-83ad-4b1f-8d1d-213cdda4d96a service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:48:39.439443 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7521e1-83ad-4b1f-8d1d-213cdda4d96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:48:39.441143 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ca7521e1-83ad-4b1f-8d1d-213cdda4d96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:48:39.501000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7521e1-83ad-4b1f-8d1d-213cdda4d96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:48:39.503104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7521e1-83ad-4b1f-8d1d-213cdda4d96a service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:48:39.512727 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1369/2732] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:48:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:49:39.283815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5af9bc-d5c4-4337-b542-393a057371f8 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:49:39.292177 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5af9bc-d5c4-4337-b542-393a057371f8 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:49:39.295752 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d8ce2-e8bc-4578-b15d-6952aa851112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:49:39.296375 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8ce2-e8bc-4578-b15d-6952aa851112 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:49:39.296652 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8ce2-e8bc-4578-b15d-6952aa851112 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:49:39.296926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8ce2-e8bc-4578-b15d-6952aa851112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:49:39.298662 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-e23d8ce2-e8bc-4578-b15d-6952aa851112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:49:39.354122 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d8ce2-e8bc-4578-b15d-6952aa851112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:49:39.355602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d8ce2-e8bc-4578-b15d-6952aa851112 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:49:39.364344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1364/2733] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:49:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:49:43.310449 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7521e1-83ad-4b1f-8d1d-213cdda4d96a service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:49:43.312348 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ca7521e1-83ad-4b1f-8d1d-213cdda4d96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:49:43.328992 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7521e1-83ad-4b1f-8d1d-213cdda4d96a service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:49:43.335108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428caa6e-8862-42b7-916b-43274ca4c086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:49:43.335788 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428caa6e-8862-42b7-916b-43274ca4c086 service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:49:43.336068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428caa6e-8862-42b7-916b-43274ca4c086 service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:49:43.336369 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428caa6e-8862-42b7-916b-43274ca4c086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:49:43.338263 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-428caa6e-8862-42b7-916b-43274ca4c086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:49:43.351251 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428caa6e-8862-42b7-916b-43274ca4c086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:49:43.352812 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428caa6e-8862-42b7-916b-43274ca4c086 service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:49:43.363411 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1370/2734] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:49:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:49:45.379020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d8ce2-e8bc-4578-b15d-6952aa851112 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:49:45.388098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d8ce2-e8bc-4578-b15d-6952aa851112 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:49:45.391741 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cc8ea-7992-4dbc-9006-fea7544ab6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:49:45.392368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cc8ea-7992-4dbc-9006-fea7544ab6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:49:45.392637 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cc8ea-7992-4dbc-9006-fea7544ab6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:49:45.392904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cc8ea-7992-4dbc-9006-fea7544ab6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:49:45.394647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-284cc8ea-7992-4dbc-9006-fea7544ab6c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:49:45.454832 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cc8ea-7992-4dbc-9006-fea7544ab6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:49:45.456210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cc8ea-7992-4dbc-9006-fea7544ab6c4 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:49:45.465456 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1365/2735] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:49:51.460026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428caa6e-8862-42b7-916b-43274ca4c086 service nova] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:49:51.461784 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-428caa6e-8862-42b7-916b-43274ca4c086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:49:51.484784 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428caa6e-8862-42b7-916b-43274ca4c086 service nova] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:49:51.491509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:49:51.492468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:49:51.493236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:49:51.493236 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] PATH_INFO: `/v3/users/190e89da56994743b62d3b573527b405` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:49:51.494388 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=190e89da56994743b62d3b573527b405)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:49:51.499037 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:49:51.547194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190e89da56994743b62d3b573527b405'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:51.547864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190e89da56994743b62d3b573527b405'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:51.549054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190e89da56994743b62d3b573527b405'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:51.567682 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190e89da56994743b62d3b573527b405'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:51.575788 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190e89da56994743b62d3b573527b405'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:51.588044 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1371/2736] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:49:51 2022] DELETE /identity/v3/users/190e89da56994743b62d3b573527b405 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:49:51.762434 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cc8ea-7992-4dbc-9006-fea7544ab6c4 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:49:51.772125 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cc8ea-7992-4dbc-9006-fea7544ab6c4 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:49:51.826676 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:49:51.827541 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:49:51.827820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:49:51.828086 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] PATH_INFO: `/v3/projects/22ea02f677704fa687a93d29125ca6a3` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:49:51.829233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ea02f677704fa687a93d29125ca6a3)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:49:51.831147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:49:51.876627 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ea02f677704fa687a93d29125ca6a3', 'request_id': 'req-87a33605-03f9-480e-ae8d-b25466e3519d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:51.882052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ea02f677704fa687a93d29125ca6a3', 'request_id': 'req-87a33605-03f9-480e-ae8d-b25466e3519d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:51.887883 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ea02f677704fa687a93d29125ca6a3', 'request_id': 'req-87a33605-03f9-480e-ae8d-b25466e3519d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:51.899418 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] The token cache is being invalidate because project 22ea02f677704fa687a93d29125ca6a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:49:51.899703 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:51.900314 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:51.901810 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1366/2737] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:49:51 2022] DELETE /identity/v3/projects/22ea02f677704fa687a93d29125ca6a3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:49:51.905810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:49:51.907232 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:49:51.920636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da83be-c069-45b2-803d-ad51c91625a5 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:49:51.973816 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:49:51.974661 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:49:51.974968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:49:51.975240 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] PATH_INFO: `/v3/users/8c620358ce31422e82e10854ba8bbade` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:49:51.976393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c620358ce31422e82e10854ba8bbade)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:49:51.978266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:49:52.020759 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c620358ce31422e82e10854ba8bbade'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:52.021323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c620358ce31422e82e10854ba8bbade'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:52.021950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c620358ce31422e82e10854ba8bbade'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:52.033780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c620358ce31422e82e10854ba8bbade'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:52.040814 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c620358ce31422e82e10854ba8bbade'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:52.053400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1372/2738] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:49:51 2022] DELETE /identity/v3/users/8c620358ce31422e82e10854ba8bbade => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:49:52.218933 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:49:52.220756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:49:52.235043 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a33605-03f9-480e-ae8d-b25466e3519d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:49:52.289471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:49:52.290257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:49:52.290528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:49:52.290790 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] PATH_INFO: `/v3/projects/70bdad8ea6d744bfbf8ec14f71a0658b` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:49:52.292556 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=70bdad8ea6d744bfbf8ec14f71a0658b)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:49:52.294421 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:49:52.337820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70bdad8ea6d744bfbf8ec14f71a0658b', 'request_id': 'req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:52.343602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70bdad8ea6d744bfbf8ec14f71a0658b', 'request_id': 'req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:52.349351 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70bdad8ea6d744bfbf8ec14f71a0658b', 'request_id': 'req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:52.360786 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] The token cache is being invalidate because project 70bdad8ea6d744bfbf8ec14f71a0658b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:49:52.361065 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:52.361674 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:49:52.363202 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1367/2739] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:49:52 2022] DELETE /identity/v3/projects/70bdad8ea6d744bfbf8ec14f71a0658b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:50:54.296872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:50:54.298347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:50:54.402368 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13880763-88be-4073-82e9-421d9101a8bf admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:50:54.447094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8a8d2-af3b-4238-929c-8c614bb3ebec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:50:54.447722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a8d2-af3b-4238-929c-8c614bb3ebec service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:50:54.447997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a8d2-af3b-4238-929c-8c614bb3ebec service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:50:54.448266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a8d2-af3b-4238-929c-8c614bb3ebec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:50:54.450000 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-dde8a8d2-af3b-4238-929c-8c614bb3ebec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:50:54.540386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8a8d2-af3b-4238-929c-8c614bb3ebec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:50:54.541802 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8a8d2-af3b-4238-929c-8c614bb3ebec service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:50:54.551525 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1373/2740] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:51:01.073247 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:51:01.074762 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:51:01.149068 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec9ce9-d0de-4d52-87ff-8f7258d1a97e admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:51:01.154278 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:51:01.155169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:51:01.155464 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:51:01.155712 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] PATH_INFO: `/v3/users/9e3ca0cfe4ad49bd90027a7ea95bf024` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:51:01.156944 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3ca0cfe4ad49bd90027a7ea95bf024)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:51:01.158827 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:51:01.202983 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3ca0cfe4ad49bd90027a7ea95bf024'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.203563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3ca0cfe4ad49bd90027a7ea95bf024'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.215516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3ca0cfe4ad49bd90027a7ea95bf024'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.222889 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3ca0cfe4ad49bd90027a7ea95bf024'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.229603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3ca0cfe4ad49bd90027a7ea95bf024'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.235953 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1368/2741] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:51:01 2022] DELETE /identity/v3/users/9e3ca0cfe4ad49bd90027a7ea95bf024 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:51:01.398543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8a8d2-af3b-4238-929c-8c614bb3ebec service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:51:01.431066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8a8d2-af3b-4238-929c-8c614bb3ebec service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:51:01.490131 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:51:01.491016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:51:01.491356 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:51:01.491808 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] PATH_INFO: `/v3/projects/d49baa9a7922438f99d7dcc9ef7c1c15` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:51:01.493070 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d49baa9a7922438f99d7dcc9ef7c1c15)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:51:01.495202 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:51:01.543054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd49baa9a7922438f99d7dcc9ef7c1c15', 'request_id': 'req-73b7802a-c615-4db5-a391-d98e3aae1133'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.549303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd49baa9a7922438f99d7dcc9ef7c1c15', 'request_id': 'req-73b7802a-c615-4db5-a391-d98e3aae1133'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.555720 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd49baa9a7922438f99d7dcc9ef7c1c15', 'request_id': 'req-73b7802a-c615-4db5-a391-d98e3aae1133'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.569873 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] The token cache is being invalidate because project d49baa9a7922438f99d7dcc9ef7c1c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:51:01.570159 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.570813 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.575190 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1374/2742] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:51:01 2022] DELETE /identity/v3/projects/d49baa9a7922438f99d7dcc9ef7c1c15 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:51:01.576974 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:51:01.579764 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:51:01.593491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2fd20-1971-447b-95a7-35b514cb401d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:51:01.656935 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6e9b4-6e81-4665-b97a-d6facb2cffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:51:01.657816 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e9b4-6e81-4665-b97a-d6facb2cffe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:51:01.658217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e9b4-6e81-4665-b97a-d6facb2cffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:51:01.658829 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e9b4-6e81-4665-b97a-d6facb2cffe3 admin admin] PATH_INFO: `/v3/users/785d7eaa939741e487db240e69fd1b0d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:51:01.660105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6e9b4-6e81-4665-b97a-d6facb2cffe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=785d7eaa939741e487db240e69fd1b0d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:51:01.662257 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6e9b4-6e81-4665-b97a-d6facb2cffe3 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:51:01.705527 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a8f6e9b4-6e81-4665-b97a-d6facb2cffe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785d7eaa939741e487db240e69fd1b0d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.706175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a8f6e9b4-6e81-4665-b97a-d6facb2cffe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785d7eaa939741e487db240e69fd1b0d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.718045 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a8f6e9b4-6e81-4665-b97a-d6facb2cffe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785d7eaa939741e487db240e69fd1b0d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.724528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a8f6e9b4-6e81-4665-b97a-d6facb2cffe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785d7eaa939741e487db240e69fd1b0d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.731162 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-a8f6e9b4-6e81-4665-b97a-d6facb2cffe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785d7eaa939741e487db240e69fd1b0d'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:01.736842 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1369/2743] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:51:01 2022] DELETE /identity/v3/users/785d7eaa939741e487db240e69fd1b0d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:51:01.904079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:51:01.905523 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:51:01.920732 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7802a-c615-4db5-a391-d98e3aae1133 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:51:01.976225 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:51:01.977076 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:51:01.977355 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:51:01.977644 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] PATH_INFO: `/v3/projects/05ea1336781645b3a0c5f6e199e3648e` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:51:01.978790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ea1336781645b3a0c5f6e199e3648e)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:51:01.980743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:51:02.024907 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ea1336781645b3a0c5f6e199e3648e', 'request_id': 'req-5b554706-4f04-4ec9-aaa4-e6509b5601ba'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:02.030065 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ea1336781645b3a0c5f6e199e3648e', 'request_id': 'req-5b554706-4f04-4ec9-aaa4-e6509b5601ba'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:02.035924 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ea1336781645b3a0c5f6e199e3648e', 'request_id': 'req-5b554706-4f04-4ec9-aaa4-e6509b5601ba'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:02.047605 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] The token cache is being invalidate because project 05ea1336781645b3a0c5f6e199e3648e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:51:02.047890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:02.048498 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:51:02.050068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1375/2744] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:51:01 2022] DELETE /identity/v3/projects/05ea1336781645b3a0c5f6e199e3648e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:52:02.493643 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4e98-f279-482f-8dd0-0e6d798471b7 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:52:02.494164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4e98-f279-482f-8dd0-0e6d798471b7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:52:02.494164 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4e98-f279-482f-8dd0-0e6d798471b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:52:02.511126 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c92f4e98-f279-482f-8dd0-0e6d798471b7 None None] MFA Rules not processed for user `34ee2098769f4de4afc4dd5f989e90b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:52:02.512302 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c92f4e98-f279-482f-8dd0-0e6d798471b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:52:02.564617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1370/2745] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:52:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:52:02.858161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:52:02.859579 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:52:02.916258 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b554706-4f04-4ec9-aaa4-e6509b5601ba admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:52:02.919874 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c694e3a-fb82-4eb7-a7b0-3911047a9e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:52:02.920499 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c694e3a-fb82-4eb7-a7b0-3911047a9e49 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:52:02.920779 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c694e3a-fb82-4eb7-a7b0-3911047a9e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:52:02.921052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c694e3a-fb82-4eb7-a7b0-3911047a9e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:52:02.922795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2c694e3a-fb82-4eb7-a7b0-3911047a9e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:52:02.932412 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c694e3a-fb82-4eb7-a7b0-3911047a9e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:52:02.933825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c694e3a-fb82-4eb7-a7b0-3911047a9e49 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:52:02.942150 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1376/2746] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:52:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:52:03.241535 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f4e98-f279-482f-8dd0-0e6d798471b7 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:52:03.242950 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c92f4e98-f279-482f-8dd0-0e6d798471b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:52:03.311492 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f4e98-f279-482f-8dd0-0e6d798471b7 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:52:03.317070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9baac-854f-4592-98ee-52f9d57eab59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee30c8013ebb40a99d1eac7820d7f1f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:52:03.317716 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9baac-854f-4592-98ee-52f9d57eab59 service placement] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:52:03.317971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9baac-854f-4592-98ee-52f9d57eab59 service placement] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:52:03.318234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9baac-854f-4592-98ee-52f9d57eab59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:52:03.319986 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-74f9baac-854f-4592-98ee-52f9d57eab59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:52:03.331137 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9baac-854f-4592-98ee-52f9d57eab59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:52:03.332684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9baac-854f-4592-98ee-52f9d57eab59 service placement] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:52:03.342130 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1371/2747] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:52:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:52:11.440564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c694e3a-fb82-4eb7-a7b0-3911047a9e49 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:52:11.442098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-2c694e3a-fb82-4eb7-a7b0-3911047a9e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:52:11.544670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c694e3a-fb82-4eb7-a7b0-3911047a9e49 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:52:11.550257 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fce02-e5ad-4486-b6fc-fb3ccc1d78ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:52:11.550915 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fce02-e5ad-4486-b6fc-fb3ccc1d78ec service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:52:11.551215 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fce02-e5ad-4486-b6fc-fb3ccc1d78ec service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:52:11.551481 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fce02-e5ad-4486-b6fc-fb3ccc1d78ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:52:11.553221 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3b3fce02-e5ad-4486-b6fc-fb3ccc1d78ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:52:11.565400 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fce02-e5ad-4486-b6fc-fb3ccc1d78ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:52:11.566983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fce02-e5ad-4486-b6fc-fb3ccc1d78ec service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:52:11.577118 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1377/2748] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:52:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:52:11.717549 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9baac-854f-4592-98ee-52f9d57eab59 service placement] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:52:11.737926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9baac-854f-4592-98ee-52f9d57eab59 service placement] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:52:11.743807 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037398e-aab9-47c7-ac47-ccc177d202ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee30c8013ebb40a99d1eac7820d7f1f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:52:11.744656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037398e-aab9-47c7-ac47-ccc177d202ba service placement] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:52:11.744931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037398e-aab9-47c7-ac47-ccc177d202ba service placement] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:52:11.745392 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037398e-aab9-47c7-ac47-ccc177d202ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:52:11.748143 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-2037398e-aab9-47c7-ac47-ccc177d202ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:52:11.783300 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037398e-aab9-47c7-ac47-ccc177d202ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:52:11.785519 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037398e-aab9-47c7-ac47-ccc177d202ba service placement] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:52:11.798007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1372/2749] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:52:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:52:13.590713 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fce02-e5ad-4486-b6fc-fb3ccc1d78ec service nova] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:52:13.602316 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fce02-e5ad-4486-b6fc-fb3ccc1d78ec service nova] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:52:13.607656 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7b850-7042-4973-8179-fd9b85fc53bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:52:13.608273 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7b850-7042-4973-8179-fd9b85fc53bf service nova] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:52:13.608549 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7b850-7042-4973-8179-fd9b85fc53bf service nova] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:52:13.608818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7b850-7042-4973-8179-fd9b85fc53bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:52:13.610512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fee7b850-7042-4973-8179-fd9b85fc53bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:52:13.620312 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7b850-7042-4973-8179-fd9b85fc53bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:52:13.621879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7b850-7042-4973-8179-fd9b85fc53bf service nova] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:52:13.630641 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1378/2750] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:52:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:52:14.814477 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037398e-aab9-47c7-ac47-ccc177d202ba service placement] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:52:14.816098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-2037398e-aab9-47c7-ac47-ccc177d202ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:52:14.832287 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037398e-aab9-47c7-ac47-ccc177d202ba service placement] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:52:14.838267 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96756323-13b9-4995-8134-731b1712b412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4132c15e66a4a619574f7aba10d6d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:52:14.838563 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756323-13b9-4995-8134-731b1712b412 service nova] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:52:14.838845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756323-13b9-4995-8134-731b1712b412 service nova] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:52:14.839161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756323-13b9-4995-8134-731b1712b412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:52:14.840947 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-96756323-13b9-4995-8134-731b1712b412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:52:14.853851 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96756323-13b9-4995-8134-731b1712b412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:52:14.855544 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96756323-13b9-4995-8134-731b1712b412 service nova] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:52:14.866808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1373/2751] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:52:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:53:30.602130 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7b850-7042-4973-8179-fd9b85fc53bf service nova] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:30.603565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fee7b850-7042-4973-8179-fd9b85fc53bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:30.678238 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7b850-7042-4973-8179-fd9b85fc53bf service nova] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:30.681826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699ea6-9c7a-4ea1-8fc0-99a7ac5842c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:30.682451 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699ea6-9c7a-4ea1-8fc0-99a7ac5842c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:30.682731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699ea6-9c7a-4ea1-8fc0-99a7ac5842c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:30.683034 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699ea6-9c7a-4ea1-8fc0-99a7ac5842c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:30.684760 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3f699ea6-9c7a-4ea1-8fc0-99a7ac5842c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:30.698693 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f699ea6-9c7a-4ea1-8fc0-99a7ac5842c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:30.700138 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f699ea6-9c7a-4ea1-8fc0-99a7ac5842c4 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:30.710738 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1379/2752] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:53:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:53:35.887292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96756323-13b9-4995-8134-731b1712b412 service nova] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:35.897053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96756323-13b9-4995-8134-731b1712b412 service nova] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:35.900631 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd00ef-55b7-4232-b259-18c6ab2a65b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:35.901251 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd00ef-55b7-4232-b259-18c6ab2a65b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:35.901530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd00ef-55b7-4232-b259-18c6ab2a65b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:35.901802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd00ef-55b7-4232-b259-18c6ab2a65b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:35.903564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b3dd00ef-55b7-4232-b259-18c6ab2a65b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:35.916991 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd00ef-55b7-4232-b259-18c6ab2a65b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:35.918399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd00ef-55b7-4232-b259-18c6ab2a65b8 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:35.928988 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1374/2753] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:53:43.480559 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699ea6-9c7a-4ea1-8fc0-99a7ac5842c4 service cinder] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:43.481975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-3f699ea6-9c7a-4ea1-8fc0-99a7ac5842c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:43.493281 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699ea6-9c7a-4ea1-8fc0-99a7ac5842c4 service cinder] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:43.496805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5578e8-6150-47b4-93f6-788fdc70564f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:43.497441 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5578e8-6150-47b4-93f6-788fdc70564f service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:43.497699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5578e8-6150-47b4-93f6-788fdc70564f service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:43.497965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5578e8-6150-47b4-93f6-788fdc70564f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:43.499618 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-0d5578e8-6150-47b4-93f6-788fdc70564f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:43.560199 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5578e8-6150-47b4-93f6-788fdc70564f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:43.561616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5578e8-6150-47b4-93f6-788fdc70564f service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:43.571079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1380/2754] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:53:46.695694 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd00ef-55b7-4232-b259-18c6ab2a65b8 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:46.697152 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b3dd00ef-55b7-4232-b259-18c6ab2a65b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:46.711295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd00ef-55b7-4232-b259-18c6ab2a65b8 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:46.715811 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2a9b-c12c-480b-b122-714787d84984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:46.716663 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2a9b-c12c-480b-b122-714787d84984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:46.716938 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2a9b-c12c-480b-b122-714787d84984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:46.717208 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2a9b-c12c-480b-b122-714787d84984 admin admin] PATH_INFO: `/v3/users/34ee2098769f4de4afc4dd5f989e90b4` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:46.718374 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2a9b-c12c-480b-b122-714787d84984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ee2098769f4de4afc4dd5f989e90b4)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:46.720330 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2a9b-c12c-480b-b122-714787d84984 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:46.765692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e31d2a9b-c12c-480b-b122-714787d84984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ee2098769f4de4afc4dd5f989e90b4'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:46.766286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e31d2a9b-c12c-480b-b122-714787d84984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ee2098769f4de4afc4dd5f989e90b4'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:46.778215 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e31d2a9b-c12c-480b-b122-714787d84984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ee2098769f4de4afc4dd5f989e90b4'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:46.785386 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e31d2a9b-c12c-480b-b122-714787d84984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ee2098769f4de4afc4dd5f989e90b4'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:46.792111 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e31d2a9b-c12c-480b-b122-714787d84984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ee2098769f4de4afc4dd5f989e90b4'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:46.797996 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1375/2755] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:53:46 2022] DELETE /identity/v3/users/34ee2098769f4de4afc4dd5f989e90b4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:53:46.966093 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5578e8-6150-47b4-93f6-788fdc70564f service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:46.976032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5578e8-6150-47b4-93f6-788fdc70564f service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.036564 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.037410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.037686 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.037956 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] PATH_INFO: `/v3/projects/062b83dd1ce5429eb5e1cd526c5d3360` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.039323 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=062b83dd1ce5429eb5e1cd526c5d3360)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.041280 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:47.089940 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062b83dd1ce5429eb5e1cd526c5d3360', 'request_id': 'req-abeb3737-bb08-4aa5-be45-a71ac0718ca4'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:47.095417 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062b83dd1ce5429eb5e1cd526c5d3360', 'request_id': 'req-abeb3737-bb08-4aa5-be45-a71ac0718ca4'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:47.101677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062b83dd1ce5429eb5e1cd526c5d3360', 'request_id': 'req-abeb3737-bb08-4aa5-be45-a71ac0718ca4'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:47.114614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] The token cache is being invalidate because project 062b83dd1ce5429eb5e1cd526c5d3360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:53:47.114916 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:47.115536 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-abeb3737-bb08-4aa5-be45-a71ac0718ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:47.117057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1381/2756] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:53:46 2022] DELETE /identity/v3/projects/062b83dd1ce5429eb5e1cd526c5d3360 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:53:47.121952 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ebcb-e079-4b9e-bacb-b014d3711a59 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.122260 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ebcb-e079-4b9e-bacb-b014d3711a59 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.122531 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ebcb-e079-4b9e-bacb-b014d3711a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.177907 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-df84ebcb-e079-4b9e-bacb-b014d3711a59 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:53:47.179116 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-df84ebcb-e079-4b9e-bacb-b014d3711a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:47.233191 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1376/2757] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:53:47.241508 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4be41-58ac-489a-9870-3772bf9d2bb5 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.241795 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4be41-58ac-489a-9870-3772bf9d2bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.242072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4be41-58ac-489a-9870-3772bf9d2bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.260780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-84c4be41-58ac-489a-9870-3772bf9d2bb5 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:53:47.261960 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-84c4be41-58ac-489a-9870-3772bf9d2bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:47.269767 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1382/2758] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:53:47.273679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84ebcb-e079-4b9e-bacb-b014d3711a59 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:47.283128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84ebcb-e079-4b9e-bacb-b014d3711a59 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.287475 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d8a29-8ecd-40c0-9345-90f7636f0024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.288100 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d8a29-8ecd-40c0-9345-90f7636f0024 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.288375 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d8a29-8ecd-40c0-9345-90f7636f0024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.288637 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d8a29-8ecd-40c0-9345-90f7636f0024 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.289340 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d8a29-8ecd-40c0-9345-90f7636f0024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:53:47.289637 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d8a29-8ecd-40c0-9345-90f7636f0024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.291237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d8a29-8ecd-40c0-9345-90f7636f0024 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:47.302569 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1377/2759] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:53:47.306484 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4be41-58ac-489a-9870-3772bf9d2bb5 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:47.315502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4be41-58ac-489a-9870-3772bf9d2bb5 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.320695 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b0d96-e1fc-4e27-8a7e-21e0fbd809c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.321325 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0d96-e1fc-4e27-8a7e-21e0fbd809c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.321603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0d96-e1fc-4e27-8a7e-21e0fbd809c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.321878 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0d96-e1fc-4e27-8a7e-21e0fbd809c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.322574 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b0d96-e1fc-4e27-8a7e-21e0fbd809c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.324491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b0d96-e1fc-4e27-8a7e-21e0fbd809c9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:47.349389 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1383/2760] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:53:47 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:53:47.352915 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d8a29-8ecd-40c0-9345-90f7636f0024 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:47.362348 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d8a29-8ecd-40c0-9345-90f7636f0024 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.417455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dba7d5-2a99-4eea-9918-2ce8d0749a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.418105 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba7d5-2a99-4eea-9918-2ce8d0749a19 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.418378 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba7d5-2a99-4eea-9918-2ce8d0749a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.418644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba7d5-2a99-4eea-9918-2ce8d0749a19 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.419357 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dba7d5-2a99-4eea-9918-2ce8d0749a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.421233 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dba7d5-2a99-4eea-9918-2ce8d0749a19 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:47.440091 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1378/2761] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:53:47 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:53:47.444106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b0d96-e1fc-4e27-8a7e-21e0fbd809c9 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:47.454032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b0d96-e1fc-4e27-8a7e-21e0fbd809c9 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.458603 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd9a1d-ee71-4ee4-b7d0-ede161b7982a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.459277 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd9a1d-ee71-4ee4-b7d0-ede161b7982a admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.459556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd9a1d-ee71-4ee4-b7d0-ede161b7982a admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.459825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd9a1d-ee71-4ee4-b7d0-ede161b7982a admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.460532 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd9a1d-ee71-4ee4-b7d0-ede161b7982a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.462098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd9a1d-ee71-4ee4-b7d0-ede161b7982a admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:47.472517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1384/2762] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:53:47.476872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dba7d5-2a99-4eea-9918-2ce8d0749a19 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:47.486395 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dba7d5-2a99-4eea-9918-2ce8d0749a19 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.491546 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f5233-507c-4a54-8da9-84e029a31613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.492200 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f5233-507c-4a54-8da9-84e029a31613 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.492474 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f5233-507c-4a54-8da9-84e029a31613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.492739 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f5233-507c-4a54-8da9-84e029a31613 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.493442 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f5233-507c-4a54-8da9-84e029a31613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.495022 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f5233-507c-4a54-8da9-84e029a31613 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:47.504871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1379/2763] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:53:47.508742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd9a1d-ee71-4ee4-b7d0-ede161b7982a admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:47.518354 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd9a1d-ee71-4ee4-b7d0-ede161b7982a admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.522864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6c3c-f3ea-49d7-ac73-2fe61ed7e942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.523742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6c3c-f3ea-49d7-ac73-2fe61ed7e942 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.524019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6c3c-f3ea-49d7-ac73-2fe61ed7e942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.524315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6c3c-f3ea-49d7-ac73-2fe61ed7e942 admin admin] PATH_INFO: `/v3/projects/57ffa5f6a8144654953cac551bb4472b/users/f8c1e1cdd9a941fcb9c2f2e2bcf3a031/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.538625 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a6c3c-f3ea-49d7-ac73-2fe61ed7e942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ffa5f6a8144654953cac551bb4472b, user_id=f8c1e1cdd9a941fcb9c2f2e2bcf3a031, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.541213 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a6c3c-f3ea-49d7-ac73-2fe61ed7e942 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:47.554745 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1385/2764] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:53:47 2022] PUT /identity/v3/projects/57ffa5f6a8144654953cac551bb4472b/users/f8c1e1cdd9a941fcb9c2f2e2bcf3a031/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:53:47.564592 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303cc98-2f5a-4ba7-b28e-3dd5487e45d9 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.564902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303cc98-2f5a-4ba7-b28e-3dd5487e45d9 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.565169 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303cc98-2f5a-4ba7-b28e-3dd5487e45d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.590892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-9303cc98-2f5a-4ba7-b28e-3dd5487e45d9 None None] MFA Rules not processed for user `f8c1e1cdd9a941fcb9c2f2e2bcf3a031`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:53:47.592175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9303cc98-2f5a-4ba7-b28e-3dd5487e45d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:47.653424 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1380/2765] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:53:47.657906 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6c3c-f3ea-49d7-ac73-2fe61ed7e942 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:47.717095 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6c3c-f3ea-49d7-ac73-2fe61ed7e942 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.721897 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9699f-7ba7-4ff4-85d3-70569f8d8948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.722546 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9699f-7ba7-4ff4-85d3-70569f8d8948 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.722825 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9699f-7ba7-4ff4-85d3-70569f8d8948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.723139 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9699f-7ba7-4ff4-85d3-70569f8d8948 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.724326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9699f-7ba7-4ff4-85d3-70569f8d8948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.726248 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9699f-7ba7-4ff4-85d3-70569f8d8948 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:47.750448 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1386/2766] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:53:47 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:53:47.754669 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303cc98-2f5a-4ba7-b28e-3dd5487e45d9 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:47.765158 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303cc98-2f5a-4ba7-b28e-3dd5487e45d9 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.819235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a1963-1932-43fb-aa63-d2fc1626c883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.819815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a1963-1932-43fb-aa63-d2fc1626c883 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.820092 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a1963-1932-43fb-aa63-d2fc1626c883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.820358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a1963-1932-43fb-aa63-d2fc1626c883 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.821031 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a1963-1932-43fb-aa63-d2fc1626c883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.822939 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a1963-1932-43fb-aa63-d2fc1626c883 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:47.842159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1381/2767] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:53:47 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:53:47.846170 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9699f-7ba7-4ff4-85d3-70569f8d8948 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:47.856743 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9699f-7ba7-4ff4-85d3-70569f8d8948 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.861308 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6836e5-ad0c-4c55-bdd5-ae8a639c3092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.861947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6836e5-ad0c-4c55-bdd5-ae8a639c3092 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.862230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6836e5-ad0c-4c55-bdd5-ae8a639c3092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.862504 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6836e5-ad0c-4c55-bdd5-ae8a639c3092 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.863252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6836e5-ad0c-4c55-bdd5-ae8a639c3092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.864863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6836e5-ad0c-4c55-bdd5-ae8a639c3092 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:47.875331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1387/2768] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:53:47.879533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a1963-1932-43fb-aa63-d2fc1626c883 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:47.889292 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a1963-1932-43fb-aa63-d2fc1626c883 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.894753 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd415b0-0303-4034-8c33-32a04e26b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.896195 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd415b0-0303-4034-8c33-32a04e26b1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.896471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd415b0-0303-4034-8c33-32a04e26b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.896804 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd415b0-0303-4034-8c33-32a04e26b1c0 admin admin] PATH_INFO: `/v3/projects/9fdc0da8c2d547b9b4f5bfcf53ab39aa/users/5ba08e9c52d049b098be1ee50038da49/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.911767 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd415b0-0303-4034-8c33-32a04e26b1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdc0da8c2d547b9b4f5bfcf53ab39aa, user_id=5ba08e9c52d049b098be1ee50038da49, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.914369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd415b0-0303-4034-8c33-32a04e26b1c0 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:47.926625 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1382/2769] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:53:47 2022] PUT /identity/v3/projects/9fdc0da8c2d547b9b4f5bfcf53ab39aa/users/5ba08e9c52d049b098be1ee50038da49/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:53:47.930635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6836e5-ad0c-4c55-bdd5-ae8a639c3092 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:47.940315 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6836e5-ad0c-4c55-bdd5-ae8a639c3092 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:47.994347 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f6e78-f565-42ff-94da-5aedb3f55df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:47.995061 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f6e78-f565-42ff-94da-5aedb3f55df6 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:47.995343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f6e78-f565-42ff-94da-5aedb3f55df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:47.995616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f6e78-f565-42ff-94da-5aedb3f55df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:47.996326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f6e78-f565-42ff-94da-5aedb3f55df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:47.997899 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f6e78-f565-42ff-94da-5aedb3f55df6 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:48.007565 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1388/2770] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:53:48.011598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd415b0-0303-4034-8c33-32a04e26b1c0 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:48.021970 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd415b0-0303-4034-8c33-32a04e26b1c0 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:48.026498 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c6ec9-e70c-4a95-b554-95d140ce358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:48.027385 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6ec9-e70c-4a95-b554-95d140ce358b admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:48.027661 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6ec9-e70c-4a95-b554-95d140ce358b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:48.027931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6ec9-e70c-4a95-b554-95d140ce358b admin admin] PATH_INFO: `/v3/projects/9fdc0da8c2d547b9b4f5bfcf53ab39aa/users/5ba08e9c52d049b098be1ee50038da49/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:48.029870 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c6ec9-e70c-4a95-b554-95d140ce358b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdc0da8c2d547b9b4f5bfcf53ab39aa, user_id=5ba08e9c52d049b098be1ee50038da49, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:48.032730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c6ec9-e70c-4a95-b554-95d140ce358b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:48.043370 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1383/2771] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:53:48 2022] PUT /identity/v3/projects/9fdc0da8c2d547b9b4f5bfcf53ab39aa/users/5ba08e9c52d049b098be1ee50038da49/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:53:48.054708 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7dfe6-e01f-4406-ad65-a12ec4c2c6c6 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:48.055042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7dfe6-e01f-4406-ad65-a12ec4c2c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:48.055338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7dfe6-e01f-4406-ad65-a12ec4c2c6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:48.080737 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-e0c7dfe6-e01f-4406-ad65-a12ec4c2c6c6 None None] MFA Rules not processed for user `5ba08e9c52d049b098be1ee50038da49`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:53:48.081887 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-e0c7dfe6-e01f-4406-ad65-a12ec4c2c6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:48.149326 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1389/2772] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:53:48.160656 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c6ec9-e70c-4a95-b554-95d140ce358b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:48.162322 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-fb3c6ec9-e70c-4a95-b554-95d140ce358b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:48.216864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c6ec9-e70c-4a95-b554-95d140ce358b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:48.220524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265d5f0-9c1f-4181-8267-a4e8821f6d78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:48.221147 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265d5f0-9c1f-4181-8267-a4e8821f6d78 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:48.221430 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265d5f0-9c1f-4181-8267-a4e8821f6d78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:48.221701 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265d5f0-9c1f-4181-8267-a4e8821f6d78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:48.230475 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265d5f0-9c1f-4181-8267-a4e8821f6d78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:48.231917 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265d5f0-9c1f-4181-8267-a4e8821f6d78 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:48.241019 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1384/2773] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:53:48.311588 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7dfe6-e01f-4406-ad65-a12ec4c2c6c6 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:48.321380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7dfe6-e01f-4406-ad65-a12ec4c2c6c6 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:48.324941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6bdc0-7779-4ce8-af01-0368288e1fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:48.325560 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bdc0-7779-4ce8-af01-0368288e1fea service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:48.325837 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bdc0-7779-4ce8-af01-0368288e1fea service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:48.326108 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bdc0-7779-4ce8-af01-0368288e1fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:48.380712 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6bdc0-7779-4ce8-af01-0368288e1fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:48.382120 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6bdc0-7779-4ce8-af01-0368288e1fea service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:48.390762 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1390/2774] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:53:59.444023 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265d5f0-9c1f-4181-8267-a4e8821f6d78 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:59.502576 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265d5f0-9c1f-4181-8267-a4e8821f6d78 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:59.507570 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:59.508409 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:59.508683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:59.508951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] PATH_INFO: `/v3/users/f8c1e1cdd9a941fcb9c2f2e2bcf3a031` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:59.510104 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c1e1cdd9a941fcb9c2f2e2bcf3a031)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:59.512034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:59.554413 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c1e1cdd9a941fcb9c2f2e2bcf3a031'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:59.555012 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c1e1cdd9a941fcb9c2f2e2bcf3a031'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:59.566210 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c1e1cdd9a941fcb9c2f2e2bcf3a031'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:59.574102 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c1e1cdd9a941fcb9c2f2e2bcf3a031'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:59.581265 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c1e1cdd9a941fcb9c2f2e2bcf3a031'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:53:59.587795 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1385/2775] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:53:59 2022] DELETE /identity/v3/users/f8c1e1cdd9a941fcb9c2f2e2bcf3a031 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:53:59.592437 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82960579-b3d3-4960-aee0-44e66765cdba None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:59.592918 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82960579-b3d3-4960-aee0-44e66765cdba None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:59.593026 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82960579-b3d3-4960-aee0-44e66765cdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:59.609889 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-82960579-b3d3-4960-aee0-44e66765cdba None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:53:59.611100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-82960579-b3d3-4960-aee0-44e66765cdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:59.671670 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1391/2776] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:53:59.681315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:53:59.682765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:53:59.737530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c000a8-723d-41c2-8241-389c6d87cd96 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:53:59.741604 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c8a6f-ddf3-4b4b-a3f2-a291e4f014a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:53:59.742230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c8a6f-ddf3-4b4b-a3f2-a291e4f014a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:53:59.742504 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c8a6f-ddf3-4b4b-a3f2-a291e4f014a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:53:59.742770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c8a6f-ddf3-4b4b-a3f2-a291e4f014a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:53:59.751488 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c8a6f-ddf3-4b4b-a3f2-a291e4f014a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:53:59.753159 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c8a6f-ddf3-4b4b-a3f2-a291e4f014a6 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:53:59.763033 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1386/2777] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:00.019431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82960579-b3d3-4960-aee0-44e66765cdba None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:00.021052 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-82960579-b3d3-4960-aee0-44e66765cdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:00.040512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82960579-b3d3-4960-aee0-44e66765cdba None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:00.045478 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:00.046318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:00.046601 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:00.046861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] PATH_INFO: `/v3/projects/57ffa5f6a8144654953cac551bb4472b` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:00.048061 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ffa5f6a8144654953cac551bb4472b)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:00.050054 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:00.103447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ffa5f6a8144654953cac551bb4472b', 'request_id': 'req-ce92767d-847c-465b-84e1-b211bd706150'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.108568 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ffa5f6a8144654953cac551bb4472b', 'request_id': 'req-ce92767d-847c-465b-84e1-b211bd706150'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.115303 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ffa5f6a8144654953cac551bb4472b', 'request_id': 'req-ce92767d-847c-465b-84e1-b211bd706150'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.127569 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] The token cache is being invalidate because project 57ffa5f6a8144654953cac551bb4472b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:54:00.127852 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.128464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.130023 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1392/2778] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:54:00 2022] DELETE /identity/v3/projects/57ffa5f6a8144654953cac551bb4472b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:00.134704 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c8a6f-ddf3-4b4b-a3f2-a291e4f014a6 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:00.144408 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c8a6f-ddf3-4b4b-a3f2-a291e4f014a6 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:00.199750 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47be418-0de2-4b38-8419-086b78b3aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:00.200602 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47be418-0de2-4b38-8419-086b78b3aa08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:00.200873 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47be418-0de2-4b38-8419-086b78b3aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:00.201139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47be418-0de2-4b38-8419-086b78b3aa08 admin admin] PATH_INFO: `/v3/users/5ba08e9c52d049b098be1ee50038da49` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:00.202301 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47be418-0de2-4b38-8419-086b78b3aa08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba08e9c52d049b098be1ee50038da49)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:00.204221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47be418-0de2-4b38-8419-086b78b3aa08 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:00.248369 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e47be418-0de2-4b38-8419-086b78b3aa08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba08e9c52d049b098be1ee50038da49'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.248999 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e47be418-0de2-4b38-8419-086b78b3aa08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba08e9c52d049b098be1ee50038da49'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.260318 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e47be418-0de2-4b38-8419-086b78b3aa08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba08e9c52d049b098be1ee50038da49'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.267240 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e47be418-0de2-4b38-8419-086b78b3aa08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba08e9c52d049b098be1ee50038da49'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.273811 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e47be418-0de2-4b38-8419-086b78b3aa08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba08e9c52d049b098be1ee50038da49'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.279737 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1387/2779] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:54:00 2022] DELETE /identity/v3/users/5ba08e9c52d049b098be1ee50038da49 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:00.540497 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:00.541914 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:00.556636 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92767d-847c-465b-84e1-b211bd706150 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:00.613675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:00.614539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:00.614824 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:00.615133 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] PATH_INFO: `/v3/projects/9fdc0da8c2d547b9b4f5bfcf53ab39aa` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:00.616327 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fdc0da8c2d547b9b4f5bfcf53ab39aa)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:00.618242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:00.664062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fdc0da8c2d547b9b4f5bfcf53ab39aa', 'request_id': 'req-df14b7c7-b38c-4a4f-9409-2b30adeff829'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.669452 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fdc0da8c2d547b9b4f5bfcf53ab39aa', 'request_id': 'req-df14b7c7-b38c-4a4f-9409-2b30adeff829'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.675410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fdc0da8c2d547b9b4f5bfcf53ab39aa', 'request_id': 'req-df14b7c7-b38c-4a4f-9409-2b30adeff829'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.690186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] The token cache is being invalidate because project 9fdc0da8c2d547b9b4f5bfcf53ab39aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:54:00.690614 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.691521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-df14b7c7-b38c-4a4f-9409-2b30adeff829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:00.693742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1393/2780] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:54:00 2022] DELETE /identity/v3/projects/9fdc0da8c2d547b9b4f5bfcf53ab39aa => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:00.700502 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201804c6-5fbd-4c4e-a7d2-766743ffb7d2 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:00.700997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201804c6-5fbd-4c4e-a7d2-766743ffb7d2 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:00.701355 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201804c6-5fbd-4c4e-a7d2-766743ffb7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:00.725471 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-201804c6-5fbd-4c4e-a7d2-766743ffb7d2 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:00.727237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-201804c6-5fbd-4c4e-a7d2-766743ffb7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:00.783155 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1388/2781] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:00.791657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33867c45-3ef8-426a-9dc1-87a11f944756 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:00.791943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33867c45-3ef8-426a-9dc1-87a11f944756 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:00.792218 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33867c45-3ef8-426a-9dc1-87a11f944756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:00.810585 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-33867c45-3ef8-426a-9dc1-87a11f944756 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:00.811780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-33867c45-3ef8-426a-9dc1-87a11f944756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:00.819696 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1394/2782] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:00.823856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201804c6-5fbd-4c4e-a7d2-766743ffb7d2 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:00.834149 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201804c6-5fbd-4c4e-a7d2-766743ffb7d2 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:00.838611 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f2f7b-2e36-46fe-a198-7adf378a0d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:00.839272 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f2f7b-2e36-46fe-a198-7adf378a0d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:00.839545 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f2f7b-2e36-46fe-a198-7adf378a0d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:00.839809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f2f7b-2e36-46fe-a198-7adf378a0d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:00.840514 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f2f7b-2e36-46fe-a198-7adf378a0d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:54:00.840809 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f2f7b-2e36-46fe-a198-7adf378a0d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:00.842380 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f2f7b-2e36-46fe-a198-7adf378a0d93 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:00.854357 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1389/2783] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:54:00.858425 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33867c45-3ef8-426a-9dc1-87a11f944756 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:00.867477 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33867c45-3ef8-426a-9dc1-87a11f944756 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:00.872035 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff448a-6425-4c57-bb18-ea8ca283c953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:00.872657 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff448a-6425-4c57-bb18-ea8ca283c953 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:00.872932 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff448a-6425-4c57-bb18-ea8ca283c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:00.873208 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff448a-6425-4c57-bb18-ea8ca283c953 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:00.873881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff448a-6425-4c57-bb18-ea8ca283c953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:00.875776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff448a-6425-4c57-bb18-ea8ca283c953 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:00.901002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1395/2784] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:54:00 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:54:00.905020 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f2f7b-2e36-46fe-a198-7adf378a0d93 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:00.914714 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f2f7b-2e36-46fe-a198-7adf378a0d93 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:00.967054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf2522-1e0a-4b39-9cb0-3bbf0184537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:00.967699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf2522-1e0a-4b39-9cb0-3bbf0184537e admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:00.967975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf2522-1e0a-4b39-9cb0-3bbf0184537e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:00.968246 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf2522-1e0a-4b39-9cb0-3bbf0184537e admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:00.968928 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf2522-1e0a-4b39-9cb0-3bbf0184537e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:00.970813 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf2522-1e0a-4b39-9cb0-3bbf0184537e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:00.990772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1390/2785] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:54:00 2022] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:54:00.994819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff448a-6425-4c57-bb18-ea8ca283c953 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:01.005863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff448a-6425-4c57-bb18-ea8ca283c953 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:01.011145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e4edd-74ca-47b5-a6a5-bdc7e4b17d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:01.011800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e4edd-74ca-47b5-a6a5-bdc7e4b17d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.012088 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e4edd-74ca-47b5-a6a5-bdc7e4b17d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.012349 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e4edd-74ca-47b5-a6a5-bdc7e4b17d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.013062 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e4edd-74ca-47b5-a6a5-bdc7e4b17d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:01.014638 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e4edd-74ca-47b5-a6a5-bdc7e4b17d5b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:01.025731 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1396/2786] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:01.029853 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf2522-1e0a-4b39-9cb0-3bbf0184537e admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:01.039658 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf2522-1e0a-4b39-9cb0-3bbf0184537e admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:01.044296 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e39989-0561-4f85-a02a-0b2e8e80e7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:01.044951 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e39989-0561-4f85-a02a-0b2e8e80e7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.045221 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e39989-0561-4f85-a02a-0b2e8e80e7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.045496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e39989-0561-4f85-a02a-0b2e8e80e7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.046244 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e39989-0561-4f85-a02a-0b2e8e80e7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:01.047864 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e39989-0561-4f85-a02a-0b2e8e80e7b8 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:01.057348 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1391/2787] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:01.061110 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e4edd-74ca-47b5-a6a5-bdc7e4b17d5b admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:01.071147 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e4edd-74ca-47b5-a6a5-bdc7e4b17d5b admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:01.075914 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d8759-2045-493c-8238-8958d00e02a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:01.076807 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d8759-2045-493c-8238-8958d00e02a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.077094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d8759-2045-493c-8238-8958d00e02a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.077366 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d8759-2045-493c-8238-8958d00e02a8 admin admin] PATH_INFO: `/v3/projects/25b559d5a8e44bbb8a76b31becdadee2/users/65ea869ebd274da8be9d07a0aabce33c/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.092498 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d8759-2045-493c-8238-8958d00e02a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b559d5a8e44bbb8a76b31becdadee2, user_id=65ea869ebd274da8be9d07a0aabce33c, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:01.095294 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d8759-2045-493c-8238-8958d00e02a8 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:01.107491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1397/2788] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:01 2022] PUT /identity/v3/projects/25b559d5a8e44bbb8a76b31becdadee2/users/65ea869ebd274da8be9d07a0aabce33c/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:54:01.117683 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7039a7-368b-499d-afe3-3411d76df4fe None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.117971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7039a7-368b-499d-afe3-3411d76df4fe None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.118249 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7039a7-368b-499d-afe3-3411d76df4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.144927 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-4c7039a7-368b-499d-afe3-3411d76df4fe None None] MFA Rules not processed for user `65ea869ebd274da8be9d07a0aabce33c`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:01.146712 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-4c7039a7-368b-499d-afe3-3411d76df4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:01.207515 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1392/2789] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:01.212671 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d8759-2045-493c-8238-8958d00e02a8 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:01.272554 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d8759-2045-493c-8238-8958d00e02a8 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:01.277123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faa754-6c25-4a62-9189-9347722eac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:01.277755 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa754-6c25-4a62-9189-9347722eac60 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.278031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa754-6c25-4a62-9189-9347722eac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.278297 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa754-6c25-4a62-9189-9347722eac60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.279013 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faa754-6c25-4a62-9189-9347722eac60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:01.280875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faa754-6c25-4a62-9189-9347722eac60 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:01.305129 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1398/2790] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:54:01 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:54:01.309051 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7039a7-368b-499d-afe3-3411d76df4fe None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:01.319942 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7039a7-368b-499d-afe3-3411d76df4fe None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:01.371232 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42440f6c-d204-487b-8666-42d5734fbe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:01.371872 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42440f6c-d204-487b-8666-42d5734fbe2a admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.372145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42440f6c-d204-487b-8666-42d5734fbe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.372412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42440f6c-d204-487b-8666-42d5734fbe2a admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.373083 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42440f6c-d204-487b-8666-42d5734fbe2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:01.374987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42440f6c-d204-487b-8666-42d5734fbe2a admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:01.394820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1393/2791] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:54:01 2022] POST /identity/v3/users => generated 294 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:54:01.398763 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faa754-6c25-4a62-9189-9347722eac60 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:01.408866 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faa754-6c25-4a62-9189-9347722eac60 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:01.413464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94eeff2-4ed2-4f47-aec1-3a95fca946c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:01.414104 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94eeff2-4ed2-4f47-aec1-3a95fca946c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.414398 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94eeff2-4ed2-4f47-aec1-3a95fca946c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.414663 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94eeff2-4ed2-4f47-aec1-3a95fca946c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.415415 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94eeff2-4ed2-4f47-aec1-3a95fca946c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:01.417024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94eeff2-4ed2-4f47-aec1-3a95fca946c9 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:01.427586 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1399/2792] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:01.431348 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42440f6c-d204-487b-8666-42d5734fbe2a admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:01.440845 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42440f6c-d204-487b-8666-42d5734fbe2a admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:01.446139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3037ac5-d5e5-45dc-b3f5-fbb6861d54a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:01.447039 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3037ac5-d5e5-45dc-b3f5-fbb6861d54a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.447324 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3037ac5-d5e5-45dc-b3f5-fbb6861d54a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.447598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3037ac5-d5e5-45dc-b3f5-fbb6861d54a9 admin admin] PATH_INFO: `/v3/projects/6143966933134df29e216f010e1cafcf/users/f31973d51df94a4e894fc78d0b82771a/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.461979 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3037ac5-d5e5-45dc-b3f5-fbb6861d54a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6143966933134df29e216f010e1cafcf, user_id=f31973d51df94a4e894fc78d0b82771a, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:01.464596 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3037ac5-d5e5-45dc-b3f5-fbb6861d54a9 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:01.477121 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1394/2793] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:01 2022] PUT /identity/v3/projects/6143966933134df29e216f010e1cafcf/users/f31973d51df94a4e894fc78d0b82771a/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:01.481016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94eeff2-4ed2-4f47-aec1-3a95fca946c9 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:01.491587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94eeff2-4ed2-4f47-aec1-3a95fca946c9 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:01.546165 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde72309-f78e-426d-b613-50ce2e58e906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:01.546805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72309-f78e-426d-b613-50ce2e58e906 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.547120 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72309-f78e-426d-b613-50ce2e58e906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.547391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72309-f78e-426d-b613-50ce2e58e906 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.548101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde72309-f78e-426d-b613-50ce2e58e906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:01.549655 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde72309-f78e-426d-b613-50ce2e58e906 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:01.559408 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1400/2794] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:01.563420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3037ac5-d5e5-45dc-b3f5-fbb6861d54a9 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:01.574096 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3037ac5-d5e5-45dc-b3f5-fbb6861d54a9 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:01.578854 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5aea5-ee55-4b51-a4cb-75403970e039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:01.579790 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5aea5-ee55-4b51-a4cb-75403970e039 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.580070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5aea5-ee55-4b51-a4cb-75403970e039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.580342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5aea5-ee55-4b51-a4cb-75403970e039 admin admin] PATH_INFO: `/v3/projects/6143966933134df29e216f010e1cafcf/users/f31973d51df94a4e894fc78d0b82771a/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.582453 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5aea5-ee55-4b51-a4cb-75403970e039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6143966933134df29e216f010e1cafcf, user_id=f31973d51df94a4e894fc78d0b82771a, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:01.585256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5aea5-ee55-4b51-a4cb-75403970e039 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:01.595770 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1395/2795] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:01 2022] PUT /identity/v3/projects/6143966933134df29e216f010e1cafcf/users/f31973d51df94a4e894fc78d0b82771a/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:01.606881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71004bee-4042-4335-91fb-e8dd5e3328cc None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.607275 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71004bee-4042-4335-91fb-e8dd5e3328cc None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.607558 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71004bee-4042-4335-91fb-e8dd5e3328cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.634287 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-71004bee-4042-4335-91fb-e8dd5e3328cc None None] MFA Rules not processed for user `f31973d51df94a4e894fc78d0b82771a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:01.635513 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-71004bee-4042-4335-91fb-e8dd5e3328cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:01.699846 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1401/2796] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:01.710483 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5aea5-ee55-4b51-a4cb-75403970e039 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:01.712323 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-a3e5aea5-ee55-4b51-a4cb-75403970e039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:01.767852 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5aea5-ee55-4b51-a4cb-75403970e039 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:01.771524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1a00-46ea-48c3-94f2-688cf57c6985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:01.772145 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1a00-46ea-48c3-94f2-688cf57c6985 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:01.772417 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1a00-46ea-48c3-94f2-688cf57c6985 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:01.772684 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1a00-46ea-48c3-94f2-688cf57c6985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:01.825707 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf1a00-46ea-48c3-94f2-688cf57c6985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:01.827146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf1a00-46ea-48c3-94f2-688cf57c6985 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:01.835945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1396/2797] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:07.416835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71004bee-4042-4335-91fb-e8dd5e3328cc None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:07.418228 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-71004bee-4042-4335-91fb-e8dd5e3328cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:07.431150 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71004bee-4042-4335-91fb-e8dd5e3328cc None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:07.434730 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ee14c-f2dd-4b26-b941-01ad0cea3ec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:07.435392 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ee14c-f2dd-4b26-b941-01ad0cea3ec8 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:07.435675 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ee14c-f2dd-4b26-b941-01ad0cea3ec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:07.435950 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ee14c-f2dd-4b26-b941-01ad0cea3ec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:07.445608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ee14c-f2dd-4b26-b941-01ad0cea3ec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:07.447067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ee14c-f2dd-4b26-b941-01ad0cea3ec8 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:07.456524 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1402/2798] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:36.117833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1a00-46ea-48c3-94f2-688cf57c6985 service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:36.178859 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1a00-46ea-48c3-94f2-688cf57c6985 service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:36.183344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:36.184187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:36.184457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:36.184723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] PATH_INFO: `/v3/users/65ea869ebd274da8be9d07a0aabce33c` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:36.185873 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ea869ebd274da8be9d07a0aabce33c)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:36.187798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:36.231575 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ea869ebd274da8be9d07a0aabce33c'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.232235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ea869ebd274da8be9d07a0aabce33c'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.243231 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ea869ebd274da8be9d07a0aabce33c'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.250037 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ea869ebd274da8be9d07a0aabce33c'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.256765 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ea869ebd274da8be9d07a0aabce33c'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.262918 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1397/2799] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:54:36 2022] DELETE /identity/v3/users/65ea869ebd274da8be9d07a0aabce33c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:36.267527 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f1efb-91c2-4ffc-8128-d86eda4a3807 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:36.268017 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f1efb-91c2-4ffc-8128-d86eda4a3807 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:36.268125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f1efb-91c2-4ffc-8128-d86eda4a3807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:36.287269 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-830f1efb-91c2-4ffc-8128-d86eda4a3807 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:36.288468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-830f1efb-91c2-4ffc-8128-d86eda4a3807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:36.345301 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1403/2800] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:36.355041 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:36.356412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:36.413555 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b99ef9-0c47-4131-84da-7ca0ea950c6c admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:36.417332 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5a9e-0916-4dfb-87b4-4516329139b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:36.417971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5a9e-0916-4dfb-87b4-4516329139b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:36.418253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5a9e-0916-4dfb-87b4-4516329139b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:36.418524 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5a9e-0916-4dfb-87b4-4516329139b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:36.427465 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a5a9e-0916-4dfb-87b4-4516329139b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:36.429431 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a5a9e-0916-4dfb-87b4-4516329139b9 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:36.438616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1398/2801] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:36.694115 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f1efb-91c2-4ffc-8128-d86eda4a3807 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:36.696152 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-830f1efb-91c2-4ffc-8128-d86eda4a3807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:36.707875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f1efb-91c2-4ffc-8128-d86eda4a3807 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:36.712668 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:36.713540 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:36.713819 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:36.714090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] PATH_INFO: `/v3/projects/25b559d5a8e44bbb8a76b31becdadee2` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:36.715432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b559d5a8e44bbb8a76b31becdadee2)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:36.717318 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:36.763254 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b559d5a8e44bbb8a76b31becdadee2', 'request_id': 'req-de036c28-ba0a-4f51-be03-75c59f2422d3'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.768471 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b559d5a8e44bbb8a76b31becdadee2', 'request_id': 'req-de036c28-ba0a-4f51-be03-75c59f2422d3'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.774517 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b559d5a8e44bbb8a76b31becdadee2', 'request_id': 'req-de036c28-ba0a-4f51-be03-75c59f2422d3'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.786112 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] The token cache is being invalidate because project 25b559d5a8e44bbb8a76b31becdadee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:54:36.786397 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.787048 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.789071 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1404/2802] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:54:36 2022] DELETE /identity/v3/projects/25b559d5a8e44bbb8a76b31becdadee2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:36.792985 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5a9e-0916-4dfb-87b4-4516329139b9 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:36.802142 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5a9e-0916-4dfb-87b4-4516329139b9 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:36.854533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f4cf8-4a1f-4782-8477-fe25d19a674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:36.855437 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f4cf8-4a1f-4782-8477-fe25d19a674d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:36.855710 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f4cf8-4a1f-4782-8477-fe25d19a674d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:36.855975 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f4cf8-4a1f-4782-8477-fe25d19a674d admin admin] PATH_INFO: `/v3/users/f31973d51df94a4e894fc78d0b82771a` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:36.857194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f4cf8-4a1f-4782-8477-fe25d19a674d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31973d51df94a4e894fc78d0b82771a)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:36.859107 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f4cf8-4a1f-4782-8477-fe25d19a674d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:36.901235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-065f4cf8-4a1f-4782-8477-fe25d19a674d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31973d51df94a4e894fc78d0b82771a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.901798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-065f4cf8-4a1f-4782-8477-fe25d19a674d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31973d51df94a4e894fc78d0b82771a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.912754 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-065f4cf8-4a1f-4782-8477-fe25d19a674d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31973d51df94a4e894fc78d0b82771a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.919458 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-065f4cf8-4a1f-4782-8477-fe25d19a674d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31973d51df94a4e894fc78d0b82771a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.926034 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-065f4cf8-4a1f-4782-8477-fe25d19a674d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31973d51df94a4e894fc78d0b82771a'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:36.932342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1399/2803] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:54:36 2022] DELETE /identity/v3/users/f31973d51df94a4e894fc78d0b82771a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:37.187358 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:37.188835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:37.201773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de036c28-ba0a-4f51-be03-75c59f2422d3 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:37.256605 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:37.257521 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:37.257798 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:37.258066 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] PATH_INFO: `/v3/projects/6143966933134df29e216f010e1cafcf` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:37.259261 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6143966933134df29e216f010e1cafcf)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:37.261173 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:37.304621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6143966933134df29e216f010e1cafcf', 'request_id': 'req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:37.309790 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6143966933134df29e216f010e1cafcf', 'request_id': 'req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:37.316059 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6143966933134df29e216f010e1cafcf', 'request_id': 'req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:37.327396 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] The token cache is being invalidate because project 6143966933134df29e216f010e1cafcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:54:37.327681 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:37.328282 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-6d4f4557-7a0d-4bdd-9d02-62eaa3de0fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:37.329811 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1405/2804] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:54:37 2022] DELETE /identity/v3/projects/6143966933134df29e216f010e1cafcf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:37.334653 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1c5f-9399-48f5-85ff-7d1e8bea64fd None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:37.335672 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1c5f-9399-48f5-85ff-7d1e8bea64fd None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:37.335774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1c5f-9399-48f5-85ff-7d1e8bea64fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:37.353230 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-53ff1c5f-9399-48f5-85ff-7d1e8bea64fd None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:37.354406 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-53ff1c5f-9399-48f5-85ff-7d1e8bea64fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:37.409747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1400/2805] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:37.418229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e57e0-cdde-41c7-8f64-722b14081fc9 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:37.418513 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e57e0-cdde-41c7-8f64-722b14081fc9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:37.418787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e57e0-cdde-41c7-8f64-722b14081fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:37.437438 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-7d7e57e0-cdde-41c7-8f64-722b14081fc9 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:37.438557 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-7d7e57e0-cdde-41c7-8f64-722b14081fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:37.446331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1406/2806] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:37.450495 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff1c5f-9399-48f5-85ff-7d1e8bea64fd None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:37.460528 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff1c5f-9399-48f5-85ff-7d1e8bea64fd None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:37.465160 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671bdd3-773d-44d0-b68e-5e83c62f78c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:37.465814 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671bdd3-773d-44d0-b68e-5e83c62f78c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:37.466091 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671bdd3-773d-44d0-b68e-5e83c62f78c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:37.466368 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671bdd3-773d-44d0-b68e-5e83c62f78c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:37.467139 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671bdd3-773d-44d0-b68e-5e83c62f78c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:54:37.467446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671bdd3-773d-44d0-b68e-5e83c62f78c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:37.469028 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671bdd3-773d-44d0-b68e-5e83c62f78c6 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:37.480905 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1401/2807] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:54:37.484960 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e57e0-cdde-41c7-8f64-722b14081fc9 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:37.493922 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e57e0-cdde-41c7-8f64-722b14081fc9 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:37.498512 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4e4f9-f5b7-44e3-8c44-5eb986eaad14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:37.499166 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4e4f9-f5b7-44e3-8c44-5eb986eaad14 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:37.499445 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4e4f9-f5b7-44e3-8c44-5eb986eaad14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:37.499714 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4e4f9-f5b7-44e3-8c44-5eb986eaad14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:37.500394 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4e4f9-f5b7-44e3-8c44-5eb986eaad14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:37.502501 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4e4f9-f5b7-44e3-8c44-5eb986eaad14 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:37.536374 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1407/2808] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:54:37 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:54:37.540984 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671bdd3-773d-44d0-b68e-5e83c62f78c6 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:37.551053 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671bdd3-773d-44d0-b68e-5e83c62f78c6 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:37.603964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4234818-34d1-4be1-8254-4c559967a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:37.604614 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4234818-34d1-4be1-8254-4c559967a0ed admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:37.604885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4234818-34d1-4be1-8254-4c559967a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:37.605155 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4234818-34d1-4be1-8254-4c559967a0ed admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:37.605820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4234818-34d1-4be1-8254-4c559967a0ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:37.607798 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4234818-34d1-4be1-8254-4c559967a0ed admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:37.626624 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1402/2809] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:54:37 2022] POST /identity/v3/users => generated 296 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:54:37.630968 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4e4f9-f5b7-44e3-8c44-5eb986eaad14 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:37.641581 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4e4f9-f5b7-44e3-8c44-5eb986eaad14 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:37.646339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bfb99-7a07-4deb-9c0c-a15dfd08ea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:37.647009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bfb99-7a07-4deb-9c0c-a15dfd08ea96 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:37.647291 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bfb99-7a07-4deb-9c0c-a15dfd08ea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:37.648121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bfb99-7a07-4deb-9c0c-a15dfd08ea96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:37.648835 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bfb99-7a07-4deb-9c0c-a15dfd08ea96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:37.650410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bfb99-7a07-4deb-9c0c-a15dfd08ea96 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:37.660100 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1408/2810] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:37.665087 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4234818-34d1-4be1-8254-4c559967a0ed admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:37.674759 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4234818-34d1-4be1-8254-4c559967a0ed admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:37.683831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088f4f7-ff63-4786-9231-df14dfbe755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:37.683831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088f4f7-ff63-4786-9231-df14dfbe755f admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:37.683831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088f4f7-ff63-4786-9231-df14dfbe755f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:37.683831 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088f4f7-ff63-4786-9231-df14dfbe755f admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:37.684360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088f4f7-ff63-4786-9231-df14dfbe755f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:37.684360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088f4f7-ff63-4786-9231-df14dfbe755f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:37.693379 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1403/2811] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:37.697827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bfb99-7a07-4deb-9c0c-a15dfd08ea96 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:37.707416 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bfb99-7a07-4deb-9c0c-a15dfd08ea96 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:37.712566 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4593a-648d-4dac-bf49-bece5c774c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:37.713419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4593a-648d-4dac-bf49-bece5c774c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:37.713699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4593a-648d-4dac-bf49-bece5c774c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:37.713965 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4593a-648d-4dac-bf49-bece5c774c68 admin admin] PATH_INFO: `/v3/projects/c00fe7484a414687a85f8be39b212326/users/164d905f4fcb479792ce168d350c9248/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:37.728462 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4593a-648d-4dac-bf49-bece5c774c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00fe7484a414687a85f8be39b212326, user_id=164d905f4fcb479792ce168d350c9248, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:37.731122 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4593a-648d-4dac-bf49-bece5c774c68 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:37.743851 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1409/2812] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:37 2022] PUT /identity/v3/projects/c00fe7484a414687a85f8be39b212326/users/164d905f4fcb479792ce168d350c9248/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:37.755334 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8175a4-8c0d-48c6-9fb3-877ead2d790c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:37.755622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8175a4-8c0d-48c6-9fb3-877ead2d790c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:37.755897 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8175a4-8c0d-48c6-9fb3-877ead2d790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:37.782125 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-4e8175a4-8c0d-48c6-9fb3-877ead2d790c None None] MFA Rules not processed for user `164d905f4fcb479792ce168d350c9248`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:37.783349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-4e8175a4-8c0d-48c6-9fb3-877ead2d790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:37.843644 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1404/2813] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:37.848137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4593a-648d-4dac-bf49-bece5c774c68 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:37.908123 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4593a-648d-4dac-bf49-bece5c774c68 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:37.912800 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84b92c-a7a0-4e6d-abd9-b896a2e8827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:37.913490 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84b92c-a7a0-4e6d-abd9-b896a2e8827f admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:37.913793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84b92c-a7a0-4e6d-abd9-b896a2e8827f admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:37.914039 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84b92c-a7a0-4e6d-abd9-b896a2e8827f admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:37.914734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84b92c-a7a0-4e6d-abd9-b896a2e8827f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:37.916673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84b92c-a7a0-4e6d-abd9-b896a2e8827f admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:37.941286 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1410/2814] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:54:37 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:54:37.946119 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8175a4-8c0d-48c6-9fb3-877ead2d790c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:37.956478 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8175a4-8c0d-48c6-9fb3-877ead2d790c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:38.012085 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953e161-c89e-4686-92d0-01294ed85256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:38.012781 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953e161-c89e-4686-92d0-01294ed85256 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:38.013054 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953e161-c89e-4686-92d0-01294ed85256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:38.013321 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953e161-c89e-4686-92d0-01294ed85256 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:38.013997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953e161-c89e-4686-92d0-01294ed85256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:38.015921 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953e161-c89e-4686-92d0-01294ed85256 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:38.035168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1405/2815] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:54:37 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:54:38.039055 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84b92c-a7a0-4e6d-abd9-b896a2e8827f admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:38.049042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84b92c-a7a0-4e6d-abd9-b896a2e8827f admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:38.054197 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46886aff-c922-48c4-880d-423adb420d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:38.054927 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46886aff-c922-48c4-880d-423adb420d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:38.055210 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46886aff-c922-48c4-880d-423adb420d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:38.055483 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46886aff-c922-48c4-880d-423adb420d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:38.056194 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46886aff-c922-48c4-880d-423adb420d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:38.057766 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46886aff-c922-48c4-880d-423adb420d90 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:38.067975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1411/2816] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:38.072564 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953e161-c89e-4686-92d0-01294ed85256 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:38.082400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953e161-c89e-4686-92d0-01294ed85256 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:38.087420 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336910f1-5d48-4915-9ab8-a64d8bb88b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:38.088289 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336910f1-5d48-4915-9ab8-a64d8bb88b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:38.088565 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336910f1-5d48-4915-9ab8-a64d8bb88b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:38.088835 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336910f1-5d48-4915-9ab8-a64d8bb88b81 admin admin] PATH_INFO: `/v3/projects/b4107dca37864b689e168a0d59bbd9a6/users/01042b9b89be427f98a19ad4afa01154/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:38.103006 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336910f1-5d48-4915-9ab8-a64d8bb88b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4107dca37864b689e168a0d59bbd9a6, user_id=01042b9b89be427f98a19ad4afa01154, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:38.105648 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336910f1-5d48-4915-9ab8-a64d8bb88b81 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:38.119002 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1406/2817] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:38 2022] PUT /identity/v3/projects/b4107dca37864b689e168a0d59bbd9a6/users/01042b9b89be427f98a19ad4afa01154/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:38.123060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46886aff-c922-48c4-880d-423adb420d90 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:38.133643 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46886aff-c922-48c4-880d-423adb420d90 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:38.186393 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb550b-c65e-447a-bcb2-1bac4f0e43d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:38.187072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb550b-c65e-447a-bcb2-1bac4f0e43d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:38.187349 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb550b-c65e-447a-bcb2-1bac4f0e43d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:38.187619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb550b-c65e-447a-bcb2-1bac4f0e43d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:38.188329 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb550b-c65e-447a-bcb2-1bac4f0e43d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:38.189945 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb550b-c65e-447a-bcb2-1bac4f0e43d3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:38.200002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1412/2818] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:38.203985 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336910f1-5d48-4915-9ab8-a64d8bb88b81 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:38.213796 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336910f1-5d48-4915-9ab8-a64d8bb88b81 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:38.218419 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d099fae-9ffc-4752-9072-2115af0ca33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:38.219309 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d099fae-9ffc-4752-9072-2115af0ca33b admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:38.219582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d099fae-9ffc-4752-9072-2115af0ca33b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:38.219847 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d099fae-9ffc-4752-9072-2115af0ca33b admin admin] PATH_INFO: `/v3/projects/b4107dca37864b689e168a0d59bbd9a6/users/01042b9b89be427f98a19ad4afa01154/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:38.221772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d099fae-9ffc-4752-9072-2115af0ca33b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4107dca37864b689e168a0d59bbd9a6, user_id=01042b9b89be427f98a19ad4afa01154, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:38.224391 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d099fae-9ffc-4752-9072-2115af0ca33b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:38.234358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1407/2819] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:38 2022] PUT /identity/v3/projects/b4107dca37864b689e168a0d59bbd9a6/users/01042b9b89be427f98a19ad4afa01154/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:38.244815 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68df38-e6f4-40ce-ae36-70d5b1597dc7 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:38.245101 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68df38-e6f4-40ce-ae36-70d5b1597dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:38.245373 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68df38-e6f4-40ce-ae36-70d5b1597dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:38.271285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-4e68df38-e6f4-40ce-ae36-70d5b1597dc7 None None] MFA Rules not processed for user `01042b9b89be427f98a19ad4afa01154`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:38.272473 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4e68df38-e6f4-40ce-ae36-70d5b1597dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:38.343090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1413/2820] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:38.354416 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d099fae-9ffc-4752-9072-2115af0ca33b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:38.356174 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-6d099fae-9ffc-4752-9072-2115af0ca33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:38.411466 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d099fae-9ffc-4752-9072-2115af0ca33b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:38.415580 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede99a3d-2df3-4f97-9c42-3ad1808f996f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:38.416207 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede99a3d-2df3-4f97-9c42-3ad1808f996f service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:38.416484 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede99a3d-2df3-4f97-9c42-3ad1808f996f service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:38.416756 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede99a3d-2df3-4f97-9c42-3ad1808f996f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:38.425702 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede99a3d-2df3-4f97-9c42-3ad1808f996f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:38.427205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede99a3d-2df3-4f97-9c42-3ad1808f996f service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:38.437066 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1408/2821] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:38.478785 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68df38-e6f4-40ce-ae36-70d5b1597dc7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:38.480321 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-4e68df38-e6f4-40ce-ae36-70d5b1597dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:38.491941 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68df38-e6f4-40ce-ae36-70d5b1597dc7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:38.496157 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b8bf3-3172-49fd-a5dc-8449861bd536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:38.496787 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b8bf3-3172-49fd-a5dc-8449861bd536 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:38.497068 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b8bf3-3172-49fd-a5dc-8449861bd536 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:38.497343 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b8bf3-3172-49fd-a5dc-8449861bd536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:38.551229 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b8bf3-3172-49fd-a5dc-8449861bd536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:38.552635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b8bf3-3172-49fd-a5dc-8449861bd536 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:38.561818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1414/2822] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:41.697429 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede99a3d-2df3-4f97-9c42-3ad1808f996f service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:41.756345 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede99a3d-2df3-4f97-9c42-3ad1808f996f service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:41.761333 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:41.762175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:41.762444 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:41.762706 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] PATH_INFO: `/v3/users/164d905f4fcb479792ce168d350c9248` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:41.763892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=164d905f4fcb479792ce168d350c9248)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:41.765784 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:41.808858 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164d905f4fcb479792ce168d350c9248'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:41.809423 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164d905f4fcb479792ce168d350c9248'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:41.821538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164d905f4fcb479792ce168d350c9248'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:41.828360 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164d905f4fcb479792ce168d350c9248'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:41.834876 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164d905f4fcb479792ce168d350c9248'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:41.841098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1409/2823] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:54:41 2022] DELETE /identity/v3/users/164d905f4fcb479792ce168d350c9248 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:41.845722 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28dbac-47a6-4a34-9dd2-acab17b6bc9c None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:41.846223 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28dbac-47a6-4a34-9dd2-acab17b6bc9c None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:41.846339 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28dbac-47a6-4a34-9dd2-acab17b6bc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:41.863879 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-fc28dbac-47a6-4a34-9dd2-acab17b6bc9c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:41.865067 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fc28dbac-47a6-4a34-9dd2-acab17b6bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:41.921806 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1415/2824] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:41.931439 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:41.932817 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:41.989358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26524d20-153e-4bc4-b709-1c9507264127 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:41.993013 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85534ca1-d1fe-4e18-8eb3-24c93c8019cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:41.993645 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85534ca1-d1fe-4e18-8eb3-24c93c8019cf service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:41.993924 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85534ca1-d1fe-4e18-8eb3-24c93c8019cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:41.994194 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85534ca1-d1fe-4e18-8eb3-24c93c8019cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:42.003253 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85534ca1-d1fe-4e18-8eb3-24c93c8019cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:42.004703 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85534ca1-d1fe-4e18-8eb3-24c93c8019cf service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:42.014364 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1410/2825] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:42.501995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28dbac-47a6-4a34-9dd2-acab17b6bc9c None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:42.503705 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fc28dbac-47a6-4a34-9dd2-acab17b6bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:42.515793 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28dbac-47a6-4a34-9dd2-acab17b6bc9c None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:42.521169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:42.522016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:42.522314 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:42.522582 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] PATH_INFO: `/v3/projects/c00fe7484a414687a85f8be39b212326` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:42.523890 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00fe7484a414687a85f8be39b212326)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:42.525699 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:42.575413 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00fe7484a414687a85f8be39b212326', 'request_id': 'req-52145305-2ff5-4096-b56b-e46c70f47321'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:42.580543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00fe7484a414687a85f8be39b212326', 'request_id': 'req-52145305-2ff5-4096-b56b-e46c70f47321'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:42.586464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00fe7484a414687a85f8be39b212326', 'request_id': 'req-52145305-2ff5-4096-b56b-e46c70f47321'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:42.598265 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] The token cache is being invalidate because project c00fe7484a414687a85f8be39b212326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:54:42.598556 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:42.599181 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:42.600679 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1416/2826] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:54:42 2022] DELETE /identity/v3/projects/c00fe7484a414687a85f8be39b212326 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:42.604680 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85534ca1-d1fe-4e18-8eb3-24c93c8019cf service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:42.614168 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85534ca1-d1fe-4e18-8eb3-24c93c8019cf service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:42.668090 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad31eb-8f71-4d9d-87dc-de65ac22eddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:42.668940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad31eb-8f71-4d9d-87dc-de65ac22eddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:42.669219 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad31eb-8f71-4d9d-87dc-de65ac22eddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:42.669511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad31eb-8f71-4d9d-87dc-de65ac22eddc admin admin] PATH_INFO: `/v3/users/01042b9b89be427f98a19ad4afa01154` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:42.670678 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad31eb-8f71-4d9d-87dc-de65ac22eddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=01042b9b89be427f98a19ad4afa01154)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:42.672618 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad31eb-8f71-4d9d-87dc-de65ac22eddc admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:42.715655 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2fad31eb-8f71-4d9d-87dc-de65ac22eddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01042b9b89be427f98a19ad4afa01154'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:42.716273 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2fad31eb-8f71-4d9d-87dc-de65ac22eddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01042b9b89be427f98a19ad4afa01154'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:42.727493 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2fad31eb-8f71-4d9d-87dc-de65ac22eddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01042b9b89be427f98a19ad4afa01154'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:42.734138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2fad31eb-8f71-4d9d-87dc-de65ac22eddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01042b9b89be427f98a19ad4afa01154'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:42.740779 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-2fad31eb-8f71-4d9d-87dc-de65ac22eddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01042b9b89be427f98a19ad4afa01154'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:42.747094 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1411/2827] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:54:42 2022] DELETE /identity/v3/users/01042b9b89be427f98a19ad4afa01154 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:42.999542 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.000934 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:43.015186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52145305-2ff5-4096-b56b-e46c70f47321 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.069978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.070863 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.071172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.071447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] PATH_INFO: `/v3/projects/b4107dca37864b689e168a0d59bbd9a6` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.072613 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4107dca37864b689e168a0d59bbd9a6)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.074502 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:43.119680 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4107dca37864b689e168a0d59bbd9a6', 'request_id': 'req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:43.124828 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4107dca37864b689e168a0d59bbd9a6', 'request_id': 'req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:43.130975 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4107dca37864b689e168a0d59bbd9a6', 'request_id': 'req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:43.141834 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] The token cache is being invalidate because project b4107dca37864b689e168a0d59bbd9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:54:43.142149 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:43.142826 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-4bec461a-a2bd-4b1c-9896-5e4f7b6a87a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:43.144377 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1417/2828] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:54:42 2022] DELETE /identity/v3/projects/b4107dca37864b689e168a0d59bbd9a6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:43.149723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c736d-158a-42f3-9df8-fb19610ef3d5 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.150007 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c736d-158a-42f3-9df8-fb19610ef3d5 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.150279 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c736d-158a-42f3-9df8-fb19610ef3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.167791 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-110c736d-158a-42f3-9df8-fb19610ef3d5 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:43.168971 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-110c736d-158a-42f3-9df8-fb19610ef3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:43.223582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1412/2829] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:43.232051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ebd02-d933-4337-bee0-adde5a6d3696 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.232335 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ebd02-d933-4337-bee0-adde5a6d3696 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.232608 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ebd02-d933-4337-bee0-adde5a6d3696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.250319 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-fe9ebd02-d933-4337-bee0-adde5a6d3696 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:43.251468 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fe9ebd02-d933-4337-bee0-adde5a6d3696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:43.259892 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1418/2830] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:43.263906 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c736d-158a-42f3-9df8-fb19610ef3d5 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.273326 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c736d-158a-42f3-9df8-fb19610ef3d5 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.278339 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55eb26-60f2-4e17-8a94-3b91798a632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.279003 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55eb26-60f2-4e17-8a94-3b91798a632d admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.279281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55eb26-60f2-4e17-8a94-3b91798a632d admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.279552 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55eb26-60f2-4e17-8a94-3b91798a632d admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.280258 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55eb26-60f2-4e17-8a94-3b91798a632d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:54:43.280557 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55eb26-60f2-4e17-8a94-3b91798a632d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.282134 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55eb26-60f2-4e17-8a94-3b91798a632d admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:43.293876 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1413/2831] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:54:43.297887 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ebd02-d933-4337-bee0-adde5a6d3696 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.306895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ebd02-d933-4337-bee0-adde5a6d3696 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.311459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523eb92-d5c9-4e7d-8bda-f415c9778b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.312081 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523eb92-d5c9-4e7d-8bda-f415c9778b2d admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.312357 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523eb92-d5c9-4e7d-8bda-f415c9778b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.312629 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523eb92-d5c9-4e7d-8bda-f415c9778b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.313298 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523eb92-d5c9-4e7d-8bda-f415c9778b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.315200 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523eb92-d5c9-4e7d-8bda-f415c9778b2d admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:43.339533 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1419/2832] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:54:43 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:54:43.343508 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55eb26-60f2-4e17-8a94-3b91798a632d admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.353827 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55eb26-60f2-4e17-8a94-3b91798a632d admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.406597 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110b9e2-9134-4390-a590-5547f0e01189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.407281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b9e2-9134-4390-a590-5547f0e01189 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.407561 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b9e2-9134-4390-a590-5547f0e01189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.407832 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b9e2-9134-4390-a590-5547f0e01189 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.408507 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110b9e2-9134-4390-a590-5547f0e01189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.410439 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110b9e2-9134-4390-a590-5547f0e01189 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:43.430875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1414/2833] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:54:43 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:54:43.436640 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523eb92-d5c9-4e7d-8bda-f415c9778b2d admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.447440 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523eb92-d5c9-4e7d-8bda-f415c9778b2d admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.451995 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8081c-ba48-4417-ad7d-0f74a7d371e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.452631 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8081c-ba48-4417-ad7d-0f74a7d371e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.452906 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8081c-ba48-4417-ad7d-0f74a7d371e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.453172 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8081c-ba48-4417-ad7d-0f74a7d371e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.453875 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8081c-ba48-4417-ad7d-0f74a7d371e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.455475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8081c-ba48-4417-ad7d-0f74a7d371e3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:43.466019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1420/2834] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:43.470008 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110b9e2-9134-4390-a590-5547f0e01189 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.480401 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110b9e2-9134-4390-a590-5547f0e01189 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.485111 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e719995-66ca-46ef-bf5f-81d0d672df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.485747 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e719995-66ca-46ef-bf5f-81d0d672df2c admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.486021 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e719995-66ca-46ef-bf5f-81d0d672df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.486286 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e719995-66ca-46ef-bf5f-81d0d672df2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.487187 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e719995-66ca-46ef-bf5f-81d0d672df2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.488753 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e719995-66ca-46ef-bf5f-81d0d672df2c admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:43.498267 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1415/2835] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:54:43.502432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8081c-ba48-4417-ad7d-0f74a7d371e3 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.512708 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8081c-ba48-4417-ad7d-0f74a7d371e3 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.517141 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc86c3-908f-42a5-8db5-81c68dc12b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.518050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc86c3-908f-42a5-8db5-81c68dc12b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.518329 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc86c3-908f-42a5-8db5-81c68dc12b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.518597 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc86c3-908f-42a5-8db5-81c68dc12b69 admin admin] PATH_INFO: `/v3/projects/130a8dc5e5a9443c82dbe59ca2188bc3/users/dd6ef67e1bf441e68e7315073de74a22/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.533387 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc86c3-908f-42a5-8db5-81c68dc12b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130a8dc5e5a9443c82dbe59ca2188bc3, user_id=dd6ef67e1bf441e68e7315073de74a22, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.536047 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc86c3-908f-42a5-8db5-81c68dc12b69 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:43.548201 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1421/2836] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:43 2022] PUT /identity/v3/projects/130a8dc5e5a9443c82dbe59ca2188bc3/users/dd6ef67e1bf441e68e7315073de74a22/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:43.558214 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310ea90-f803-45e8-993c-ee9b5fed4bf7 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.558500 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310ea90-f803-45e8-993c-ee9b5fed4bf7 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.558773 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310ea90-f803-45e8-993c-ee9b5fed4bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.584599 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-9310ea90-f803-45e8-993c-ee9b5fed4bf7 None None] MFA Rules not processed for user `dd6ef67e1bf441e68e7315073de74a22`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:43.585769 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-9310ea90-f803-45e8-993c-ee9b5fed4bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:43.645887 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1416/2837] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:43.651024 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc86c3-908f-42a5-8db5-81c68dc12b69 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.709635 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc86c3-908f-42a5-8db5-81c68dc12b69 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.714818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366af5bc-fd06-4666-8d8d-ecca6503948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.715475 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366af5bc-fd06-4666-8d8d-ecca6503948b admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.715752 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366af5bc-fd06-4666-8d8d-ecca6503948b admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.716019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366af5bc-fd06-4666-8d8d-ecca6503948b admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.716691 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366af5bc-fd06-4666-8d8d-ecca6503948b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.718645 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366af5bc-fd06-4666-8d8d-ecca6503948b admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:43.742216 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1422/2838] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:54:43 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:54:43.746220 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310ea90-f803-45e8-993c-ee9b5fed4bf7 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.756935 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310ea90-f803-45e8-993c-ee9b5fed4bf7 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.810085 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6f646-8a9c-4fc9-a643-056264df53f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.810740 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6f646-8a9c-4fc9-a643-056264df53f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.811052 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6f646-8a9c-4fc9-a643-056264df53f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.811328 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6f646-8a9c-4fc9-a643-056264df53f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.812046 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6f646-8a9c-4fc9-a643-056264df53f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.813977 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6f646-8a9c-4fc9-a643-056264df53f4 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:43.833077 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1417/2839] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:54:43 2022] POST /identity/v3/users => generated 298 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:54:43.837493 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366af5bc-fd06-4666-8d8d-ecca6503948b admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.847492 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366af5bc-fd06-4666-8d8d-ecca6503948b admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.852040 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a23bbd-a062-415c-8335-0cfc1dbc57d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.852673 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a23bbd-a062-415c-8335-0cfc1dbc57d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.852952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a23bbd-a062-415c-8335-0cfc1dbc57d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.853223 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a23bbd-a062-415c-8335-0cfc1dbc57d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.853937 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a23bbd-a062-415c-8335-0cfc1dbc57d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.855587 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a23bbd-a062-415c-8335-0cfc1dbc57d0 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:43.865709 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1423/2840] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:43.869617 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6f646-8a9c-4fc9-a643-056264df53f4 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.879596 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6f646-8a9c-4fc9-a643-056264df53f4 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.884658 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b52747-028e-4a4b-82c4-e4d71e7c94eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.885517 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b52747-028e-4a4b-82c4-e4d71e7c94eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.885825 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b52747-028e-4a4b-82c4-e4d71e7c94eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.886098 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b52747-028e-4a4b-82c4-e4d71e7c94eb admin admin] PATH_INFO: `/v3/projects/e87e9cc579b44057b3a71bd47f11c271/users/b4a301272a1044dd97144445e038f031/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.900751 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b52747-028e-4a4b-82c4-e4d71e7c94eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87e9cc579b44057b3a71bd47f11c271, user_id=b4a301272a1044dd97144445e038f031, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.903467 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b52747-028e-4a4b-82c4-e4d71e7c94eb admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:43.915613 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1418/2841] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:43 2022] PUT /identity/v3/projects/e87e9cc579b44057b3a71bd47f11c271/users/b4a301272a1044dd97144445e038f031/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:54:43.919486 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a23bbd-a062-415c-8335-0cfc1dbc57d0 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:43.929271 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a23bbd-a062-415c-8335-0cfc1dbc57d0 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:43.988103 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba4370-1d80-4976-9ca2-f66a498f23d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:43.988754 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4370-1d80-4976-9ca2-f66a498f23d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:43.989032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4370-1d80-4976-9ca2-f66a498f23d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:43.989304 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4370-1d80-4976-9ca2-f66a498f23d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:43.990016 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba4370-1d80-4976-9ca2-f66a498f23d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:43.991618 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba4370-1d80-4976-9ca2-f66a498f23d4 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:44.001463 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1424/2842] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:54:44.005793 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b52747-028e-4a4b-82c4-e4d71e7c94eb admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:44.016299 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b52747-028e-4a4b-82c4-e4d71e7c94eb admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:44.020664 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314287e8-34b9-4c5c-ae25-fb9bc4104d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:44.021625 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314287e8-34b9-4c5c-ae25-fb9bc4104d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:44.021907 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314287e8-34b9-4c5c-ae25-fb9bc4104d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:44.022175 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314287e8-34b9-4c5c-ae25-fb9bc4104d25 admin admin] PATH_INFO: `/v3/projects/e87e9cc579b44057b3a71bd47f11c271/users/b4a301272a1044dd97144445e038f031/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:44.024128 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314287e8-34b9-4c5c-ae25-fb9bc4104d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87e9cc579b44057b3a71bd47f11c271, user_id=b4a301272a1044dd97144445e038f031, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:44.026703 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314287e8-34b9-4c5c-ae25-fb9bc4104d25 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:44.036470 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1419/2843] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:44 2022] PUT /identity/v3/projects/e87e9cc579b44057b3a71bd47f11c271/users/b4a301272a1044dd97144445e038f031/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:44.046459 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8711-5a0e-40dd-9c0b-3cad0a07e0b2 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:44.046742 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8711-5a0e-40dd-9c0b-3cad0a07e0b2 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:44.047051 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8711-5a0e-40dd-9c0b-3cad0a07e0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:44.073060 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-c94d8711-5a0e-40dd-9c0b-3cad0a07e0b2 None None] MFA Rules not processed for user `b4a301272a1044dd97144445e038f031`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:44.074249 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-c94d8711-5a0e-40dd-9c0b-3cad0a07e0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:44.139279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1425/2844] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:44.152402 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314287e8-34b9-4c5c-ae25-fb9bc4104d25 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:44.154089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-314287e8-34b9-4c5c-ae25-fb9bc4104d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:44.208622 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314287e8-34b9-4c5c-ae25-fb9bc4104d25 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:44.212185 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143969-b8d5-466c-9e5b-a08b1b30067e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:44.212801 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143969-b8d5-466c-9e5b-a08b1b30067e service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:44.213075 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143969-b8d5-466c-9e5b-a08b1b30067e service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:44.213344 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143969-b8d5-466c-9e5b-a08b1b30067e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:44.221954 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54143969-b8d5-466c-9e5b-a08b1b30067e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:44.223394 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54143969-b8d5-466c-9e5b-a08b1b30067e service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:44.232413 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1420/2845] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:44.300689 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d8711-5a0e-40dd-9c0b-3cad0a07e0b2 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:44.314976 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d8711-5a0e-40dd-9c0b-3cad0a07e0b2 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:44.318776 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b55a2-3bb3-4844-827b-5c398c8446b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:44.319450 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b55a2-3bb3-4844-827b-5c398c8446b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:44.319728 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b55a2-3bb3-4844-827b-5c398c8446b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:44.319999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b55a2-3bb3-4844-827b-5c398c8446b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:44.374406 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b55a2-3bb3-4844-827b-5c398c8446b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:44.375865 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b55a2-3bb3-4844-827b-5c398c8446b1 service cinder] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:44.384767 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1426/2846] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:44.631235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143969-b8d5-466c-9e5b-a08b1b30067e service cinder] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:44.689070 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143969-b8d5-466c-9e5b-a08b1b30067e service cinder] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:44.693501 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:44.694332 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:44.694606 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:44.694871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] PATH_INFO: `/v3/users/dd6ef67e1bf441e68e7315073de74a22` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:44.696084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6ef67e1bf441e68e7315073de74a22)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:44.697981 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:44.740781 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6ef67e1bf441e68e7315073de74a22'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:44.741415 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6ef67e1bf441e68e7315073de74a22'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:44.752802 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6ef67e1bf441e68e7315073de74a22'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:44.759566 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6ef67e1bf441e68e7315073de74a22'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:44.766042 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6ef67e1bf441e68e7315073de74a22'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:44.771929 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1421/2847] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:54:44 2022] DELETE /identity/v3/users/dd6ef67e1bf441e68e7315073de74a22 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:44.776897 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc64bf-3f8d-4cab-8bcb-69866a82d390 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:44.777184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc64bf-3f8d-4cab-8bcb-69866a82d390 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:44.777461 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc64bf-3f8d-4cab-8bcb-69866a82d390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:44.794881 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-a7fc64bf-3f8d-4cab-8bcb-69866a82d390 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:44.796094 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a7fc64bf-3f8d-4cab-8bcb-69866a82d390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:44.850653 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1427/2848] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:44.861182 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:44.862574 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:44.918944 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b9e15-13f4-4cb6-a3c3-ca63ef8215af admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:44.922481 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7fa56-d9eb-452d-9ad2-9911675c8264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:44.923150 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fa56-d9eb-452d-9ad2-9911675c8264 service neutron] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:44.923427 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fa56-d9eb-452d-9ad2-9911675c8264 service neutron] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:44.923693 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fa56-d9eb-452d-9ad2-9911675c8264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:44.932406 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7fa56-d9eb-452d-9ad2-9911675c8264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:44.933823 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7fa56-d9eb-452d-9ad2-9911675c8264 service neutron] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:44.942873 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1422/2849] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:45.199072 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc64bf-3f8d-4cab-8bcb-69866a82d390 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:45.200527 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-a7fc64bf-3f8d-4cab-8bcb-69866a82d390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:45.212948 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc64bf-3f8d-4cab-8bcb-69866a82d390 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:45.217923 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:45.218773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:45.219082 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:45.219359 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] PATH_INFO: `/v3/projects/130a8dc5e5a9443c82dbe59ca2188bc3` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:45.220749 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=130a8dc5e5a9443c82dbe59ca2188bc3)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:45.222639 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:45.267050 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130a8dc5e5a9443c82dbe59ca2188bc3', 'request_id': 'req-fc0a2ce7-5e38-4494-8f69-54badeb80006'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.272317 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130a8dc5e5a9443c82dbe59ca2188bc3', 'request_id': 'req-fc0a2ce7-5e38-4494-8f69-54badeb80006'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.278707 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130a8dc5e5a9443c82dbe59ca2188bc3', 'request_id': 'req-fc0a2ce7-5e38-4494-8f69-54badeb80006'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.289978 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] The token cache is being invalidate because project 130a8dc5e5a9443c82dbe59ca2188bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:54:45.290266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.290870 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.292378 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1428/2850] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:54:45 2022] DELETE /identity/v3/projects/130a8dc5e5a9443c82dbe59ca2188bc3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:54:45.296383 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7fa56-d9eb-452d-9ad2-9911675c8264 service neutron] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:45.305836 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7fa56-d9eb-452d-9ad2-9911675c8264 service neutron] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:45.370491 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485a9d7-f7a1-4e2a-9734-419f06f1b4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:45.371843 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a9d7-f7a1-4e2a-9734-419f06f1b4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:45.372146 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a9d7-f7a1-4e2a-9734-419f06f1b4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:45.372412 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a9d7-f7a1-4e2a-9734-419f06f1b4ea admin admin] PATH_INFO: `/v3/users/b4a301272a1044dd97144445e038f031` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:45.373586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485a9d7-f7a1-4e2a-9734-419f06f1b4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a301272a1044dd97144445e038f031)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:45.375641 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485a9d7-f7a1-4e2a-9734-419f06f1b4ea admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:45.419853 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-4485a9d7-f7a1-4e2a-9734-419f06f1b4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a301272a1044dd97144445e038f031'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.420509 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-4485a9d7-f7a1-4e2a-9734-419f06f1b4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a301272a1044dd97144445e038f031'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.432095 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-4485a9d7-f7a1-4e2a-9734-419f06f1b4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a301272a1044dd97144445e038f031'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.438657 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-4485a9d7-f7a1-4e2a-9734-419f06f1b4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a301272a1044dd97144445e038f031'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.445171 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-4485a9d7-f7a1-4e2a-9734-419f06f1b4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a301272a1044dd97144445e038f031'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.451512 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1423/2851] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:54:45 2022] DELETE /identity/v3/users/b4a301272a1044dd97144445e038f031 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:45.704818 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:45.706509 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:45.722402 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a2ce7-5e38-4494-8f69-54badeb80006 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:45.778079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:45.778954 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:45.779237 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:45.779506 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] PATH_INFO: `/v3/projects/e87e9cc579b44057b3a71bd47f11c271` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:45.780706 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87e9cc579b44057b3a71bd47f11c271)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:45.782598 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:45.826678 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87e9cc579b44057b3a71bd47f11c271', 'request_id': 'req-57ddc9ba-8902-471d-aed5-87399b17f832'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.832391 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87e9cc579b44057b3a71bd47f11c271', 'request_id': 'req-57ddc9ba-8902-471d-aed5-87399b17f832'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.838426 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87e9cc579b44057b3a71bd47f11c271', 'request_id': 'req-57ddc9ba-8902-471d-aed5-87399b17f832'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.850131 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] The token cache is being invalidate because project e87e9cc579b44057b3a71bd47f11c271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:54:45.850419 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.851079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-57ddc9ba-8902-471d-aed5-87399b17f832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:45.853098 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1429/2852] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:54:45 2022] DELETE /identity/v3/projects/e87e9cc579b44057b3a71bd47f11c271 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:45.857997 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3ef56-4ce2-4c63-885a-98e30ba495e8 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:45.858479 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3ef56-4ce2-4c63-885a-98e30ba495e8 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:45.858582 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3ef56-4ce2-4c63-885a-98e30ba495e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:45.876485 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-c2a3ef56-4ce2-4c63-885a-98e30ba495e8 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:45.878008 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-c2a3ef56-4ce2-4c63-885a-98e30ba495e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:45.934660 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1424/2853] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:54:45.943363 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce001b-dfa2-4cc2-8583-d2f7768c79a7 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:45.943650 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce001b-dfa2-4cc2-8583-d2f7768c79a7 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:45.943920 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce001b-dfa2-4cc2-8583-d2f7768c79a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:45.962059 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-efce001b-dfa2-4cc2-8583-d2f7768c79a7 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:45.963279 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-efce001b-dfa2-4cc2-8583-d2f7768c79a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:45.971012 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1430/2854] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:45.975186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3ef56-4ce2-4c63-885a-98e30ba495e8 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:45.985183 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3ef56-4ce2-4c63-885a-98e30ba495e8 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:45.989699 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edf6c6-b612-4488-b7ec-9130ec982b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:45.990339 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edf6c6-b612-4488-b7ec-9130ec982b04 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:45.990616 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edf6c6-b612-4488-b7ec-9130ec982b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:45.990888 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edf6c6-b612-4488-b7ec-9130ec982b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:45.991629 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edf6c6-b612-4488-b7ec-9130ec982b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:54:45.991926 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edf6c6-b612-4488-b7ec-9130ec982b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:45.994088 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edf6c6-b612-4488-b7ec-9130ec982b04 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.005496 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1425/2855] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:54:46.009737 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce001b-dfa2-4cc2-8583-d2f7768c79a7 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.018723 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce001b-dfa2-4cc2-8583-d2f7768c79a7 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.023266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b49136-e0b5-497a-b69e-e408271d73b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.023895 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49136-e0b5-497a-b69e-e408271d73b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.024171 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49136-e0b5-497a-b69e-e408271d73b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.024438 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49136-e0b5-497a-b69e-e408271d73b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.025109 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b49136-e0b5-497a-b69e-e408271d73b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.027009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b49136-e0b5-497a-b69e-e408271d73b8 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.051741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1431/2856] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:54:46 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:54:46.056516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edf6c6-b612-4488-b7ec-9130ec982b04 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.066234 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edf6c6-b612-4488-b7ec-9130ec982b04 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.121387 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202378-4177-4c3b-b18c-3d6302c7f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.122040 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202378-4177-4c3b-b18c-3d6302c7f86b admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.122315 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202378-4177-4c3b-b18c-3d6302c7f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.122586 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202378-4177-4c3b-b18c-3d6302c7f86b admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.123297 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22202378-4177-4c3b-b18c-3d6302c7f86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.125186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22202378-4177-4c3b-b18c-3d6302c7f86b admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.146865 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1426/2857] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:54:46 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:54:46.151491 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b49136-e0b5-497a-b69e-e408271d73b8 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.161376 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b49136-e0b5-497a-b69e-e408271d73b8 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.166542 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158bb3a-79f9-4328-b116-9668c3f3dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.167209 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158bb3a-79f9-4328-b116-9668c3f3dd22 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.167487 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158bb3a-79f9-4328-b116-9668c3f3dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.167756 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158bb3a-79f9-4328-b116-9668c3f3dd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.168464 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158bb3a-79f9-4328-b116-9668c3f3dd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.170030 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158bb3a-79f9-4328-b116-9668c3f3dd22 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.180019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1432/2858] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:54:46.183821 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202378-4177-4c3b-b18c-3d6302c7f86b admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.193217 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202378-4177-4c3b-b18c-3d6302c7f86b admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.197723 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d85316-f228-4c2e-ac3c-0f9d5bb666fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.198349 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85316-f228-4c2e-ac3c-0f9d5bb666fb admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.198623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85316-f228-4c2e-ac3c-0f9d5bb666fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.198892 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85316-f228-4c2e-ac3c-0f9d5bb666fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.199623 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d85316-f228-4c2e-ac3c-0f9d5bb666fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.201227 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d85316-f228-4c2e-ac3c-0f9d5bb666fb admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.210806 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1427/2859] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:46.215077 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158bb3a-79f9-4328-b116-9668c3f3dd22 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.224688 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158bb3a-79f9-4328-b116-9668c3f3dd22 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.229885 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b609a-5ed3-4780-9384-3e782afe1390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.230748 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b609a-5ed3-4780-9384-3e782afe1390 admin admin] REQUEST_METHOD: `PUT` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.231064 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b609a-5ed3-4780-9384-3e782afe1390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.231337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b609a-5ed3-4780-9384-3e782afe1390 admin admin] PATH_INFO: `/v3/projects/32fe7268ec3744fdb5909d2c22c325f3/users/bce14a6b85af49ec8ca84dd61392e453/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.245764 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b609a-5ed3-4780-9384-3e782afe1390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fe7268ec3744fdb5909d2c22c325f3, user_id=bce14a6b85af49ec8ca84dd61392e453, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.248418 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b609a-5ed3-4780-9384-3e782afe1390 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.260910 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1433/2860] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:46 2022] PUT /identity/v3/projects/32fe7268ec3744fdb5909d2c22c325f3/users/bce14a6b85af49ec8ca84dd61392e453/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:46.271281 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395118b1-9906-45d3-8083-c26740cc2c6e None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.271572 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395118b1-9906-45d3-8083-c26740cc2c6e None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.271849 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395118b1-9906-45d3-8083-c26740cc2c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.298167 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-395118b1-9906-45d3-8083-c26740cc2c6e None None] MFA Rules not processed for user `bce14a6b85af49ec8ca84dd61392e453`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:46.299400 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-395118b1-9906-45d3-8083-c26740cc2c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:46.360156 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1428/2861] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:46.364734 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b609a-5ed3-4780-9384-3e782afe1390 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.424069 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b609a-5ed3-4780-9384-3e782afe1390 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.428810 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f49acb-00e9-41ff-ac63-6be88eb10854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.429447 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f49acb-00e9-41ff-ac63-6be88eb10854 admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.429733 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f49acb-00e9-41ff-ac63-6be88eb10854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.429992 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f49acb-00e9-41ff-ac63-6be88eb10854 admin admin] PATH_INFO: `/v3/projects` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.430677 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f49acb-00e9-41ff-ac63-6be88eb10854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.432575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f49acb-00e9-41ff-ac63-6be88eb10854 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.456911 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1434/2862] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:54:46 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:54:46.461005 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395118b1-9906-45d3-8083-c26740cc2c6e None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.472138 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395118b1-9906-45d3-8083-c26740cc2c6e None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.526994 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acac8c-18dd-49e0-a58c-0f6749a2dfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.527904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acac8c-18dd-49e0-a58c-0f6749a2dfbb admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.527904 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acac8c-18dd-49e0-a58c-0f6749a2dfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.528117 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acac8c-18dd-49e0-a58c-0f6749a2dfbb admin admin] PATH_INFO: `/v3/users` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.529082 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acac8c-18dd-49e0-a58c-0f6749a2dfbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.530987 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acac8c-18dd-49e0-a58c-0f6749a2dfbb admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.550647 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1429/2863] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:54:46 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:54:46.554543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f49acb-00e9-41ff-ac63-6be88eb10854 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.564581 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f49acb-00e9-41ff-ac63-6be88eb10854 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.569090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb13505-da90-4e7c-9f96-24583d619101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.569893 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb13505-da90-4e7c-9f96-24583d619101 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.570169 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb13505-da90-4e7c-9f96-24583d619101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.570440 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb13505-da90-4e7c-9f96-24583d619101 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.571186 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb13505-da90-4e7c-9f96-24583d619101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.573242 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb13505-da90-4e7c-9f96-24583d619101 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.582684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1435/2864] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:46.586542 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acac8c-18dd-49e0-a58c-0f6749a2dfbb admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.596856 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acac8c-18dd-49e0-a58c-0f6749a2dfbb admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.601603 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f12bd-6bc5-4904-bbc0-2cdfd9f3ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.602458 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f12bd-6bc5-4904-bbc0-2cdfd9f3ffa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.602730 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f12bd-6bc5-4904-bbc0-2cdfd9f3ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.603035 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f12bd-6bc5-4904-bbc0-2cdfd9f3ffa1 admin admin] PATH_INFO: `/v3/projects/dd381556f3354ca8a5c91e5518637266/users/e3a6966b16f54b6ea0ee80dff1458e1b/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.617238 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f12bd-6bc5-4904-bbc0-2cdfd9f3ffa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd381556f3354ca8a5c91e5518637266, user_id=e3a6966b16f54b6ea0ee80dff1458e1b, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.619902 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f12bd-6bc5-4904-bbc0-2cdfd9f3ffa1 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.632598 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1430/2865] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:46 2022] PUT /identity/v3/projects/dd381556f3354ca8a5c91e5518637266/users/e3a6966b16f54b6ea0ee80dff1458e1b/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:46.636986 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb13505-da90-4e7c-9f96-24583d619101 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.646690 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb13505-da90-4e7c-9f96-24583d619101 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.713156 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae275ca-4fec-4dce-ab7d-80462eb31a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.713723 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae275ca-4fec-4dce-ab7d-80462eb31a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.713999 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae275ca-4fec-4dce-ab7d-80462eb31a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.714266 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae275ca-4fec-4dce-ab7d-80462eb31a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.715002 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae275ca-4fec-4dce-ab7d-80462eb31a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.716576 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae275ca-4fec-4dce-ab7d-80462eb31a90 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.726028 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1436/2866] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:46.730188 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f12bd-6bc5-4904-bbc0-2cdfd9f3ffa1 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.742853 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f12bd-6bc5-4904-bbc0-2cdfd9f3ffa1 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.747534 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce82f2-8bc3-4bfa-a63d-a00fb9176913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.748399 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce82f2-8bc3-4bfa-a63d-a00fb9176913 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.748671 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce82f2-8bc3-4bfa-a63d-a00fb9176913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.748940 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce82f2-8bc3-4bfa-a63d-a00fb9176913 admin admin] PATH_INFO: `/v3/projects/dd381556f3354ca8a5c91e5518637266/users/e3a6966b16f54b6ea0ee80dff1458e1b/roles/c165d9ae44384936842d67d7cafd3f7d` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.750870 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce82f2-8bc3-4bfa-a63d-a00fb9176913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd381556f3354ca8a5c91e5518637266, user_id=e3a6966b16f54b6ea0ee80dff1458e1b, role_id=c165d9ae44384936842d67d7cafd3f7d)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.753761 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce82f2-8bc3-4bfa-a63d-a00fb9176913 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:46.764250 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1431/2867] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:46 2022] PUT /identity/v3/projects/dd381556f3354ca8a5c91e5518637266/users/e3a6966b16f54b6ea0ee80dff1458e1b/roles/c165d9ae44384936842d67d7cafd3f7d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:46.775140 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c80d4-2ae2-4bae-b97b-e2a7a1e9c7b9 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.775427 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c80d4-2ae2-4bae-b97b-e2a7a1e9c7b9 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.775698 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c80d4-2ae2-4bae-b97b-e2a7a1e9c7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.800741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-dc0c80d4-2ae2-4bae-b97b-e2a7a1e9c7b9 None None] MFA Rules not processed for user `e3a6966b16f54b6ea0ee80dff1458e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:46.801917 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-dc0c80d4-2ae2-4bae-b97b-e2a7a1e9c7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:46.867079 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1437/2868] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:46.878404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce82f2-8bc3-4bfa-a63d-a00fb9176913 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:46.880207 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-ccce82f2-8bc3-4bfa-a63d-a00fb9176913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:46.934568 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce82f2-8bc3-4bfa-a63d-a00fb9176913 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:46.938242 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61385c96-707d-490e-8760-2928ed64f518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:46.938870 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61385c96-707d-490e-8760-2928ed64f518 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:46.939181 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61385c96-707d-490e-8760-2928ed64f518 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:46.939455 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61385c96-707d-490e-8760-2928ed64f518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:46.991789 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61385c96-707d-490e-8760-2928ed64f518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:46.993640 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61385c96-707d-490e-8760-2928ed64f518 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:47.002530 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1432/2869] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:49.484994 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c80d4-2ae2-4bae-b97b-e2a7a1e9c7b9 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:49.543943 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c80d4-2ae2-4bae-b97b-e2a7a1e9c7b9 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:49.548466 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:49.549342 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:49.549619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:49.549883 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] PATH_INFO: `/v3/users/bce14a6b85af49ec8ca84dd61392e453` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:49.551090 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce14a6b85af49ec8ca84dd61392e453)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:49.552983 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:49.596382 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce14a6b85af49ec8ca84dd61392e453'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:49.597022 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce14a6b85af49ec8ca84dd61392e453'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:49.597616 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce14a6b85af49ec8ca84dd61392e453'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:49.608794 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce14a6b85af49ec8ca84dd61392e453'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:49.615297 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce14a6b85af49ec8ca84dd61392e453'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:49.626861 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1438/2870] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:54:49 2022] DELETE /identity/v3/users/bce14a6b85af49ec8ca84dd61392e453 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:49.631666 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56685-02b1-4c7e-878a-fe1bc9583863 None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:49.632186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56685-02b1-4c7e-878a-fe1bc9583863 None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:49.632186 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56685-02b1-4c7e-878a-fe1bc9583863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:49.650089 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-02d56685-02b1-4c7e-878a-fe1bc9583863 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:49.651330 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-02d56685-02b1-4c7e-878a-fe1bc9583863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:49.705785 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1433/2871] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:49.715997 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:49.717333 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:49.771571 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489a840-ff0b-4a5e-a9db-f98cf66a3c19 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:49.775741 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f4e63-a93b-43d3-8254-11fd4a52bdce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:49.776386 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4e63-a93b-43d3-8254-11fd4a52bdce service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:49.776646 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4e63-a93b-43d3-8254-11fd4a52bdce service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:49.776916 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4e63-a93b-43d3-8254-11fd4a52bdce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:49.785543 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f4e63-a93b-43d3-8254-11fd4a52bdce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:49.786971 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f4e63-a93b-43d3-8254-11fd4a52bdce service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:49.795992 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1439/2872] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:54:50.046498 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d56685-02b1-4c7e-878a-fe1bc9583863 None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:50.048027 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-02d56685-02b1-4c7e-878a-fe1bc9583863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:50.060732 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d56685-02b1-4c7e-878a-fe1bc9583863 None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:50.065252 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:50.066235 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:50.066511 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:50.066772 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] PATH_INFO: `/v3/projects/32fe7268ec3744fdb5909d2c22c325f3` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:50.068601 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fe7268ec3744fdb5909d2c22c325f3)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:50.070498 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:50.117205 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fe7268ec3744fdb5909d2c22c325f3', 'request_id': 'req-b0810817-e693-49ee-8680-554cec553e02'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.123024 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fe7268ec3744fdb5909d2c22c325f3', 'request_id': 'req-b0810817-e693-49ee-8680-554cec553e02'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.129551 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fe7268ec3744fdb5909d2c22c325f3', 'request_id': 'req-b0810817-e693-49ee-8680-554cec553e02'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.142003 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] The token cache is being invalidate because project 32fe7268ec3744fdb5909d2c22c325f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:54:50.142283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.142984 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.144619 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1434/2873] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:54:50 2022] DELETE /identity/v3/projects/32fe7268ec3744fdb5909d2c22c325f3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:50.148777 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f4e63-a93b-43d3-8254-11fd4a52bdce service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:50.158289 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f4e63-a93b-43d3-8254-11fd4a52bdce service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:50.212111 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064b3aa-ab4a-4724-b443-52e8c950b4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:50.212952 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064b3aa-ab4a-4724-b443-52e8c950b4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:50.213235 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064b3aa-ab4a-4724-b443-52e8c950b4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:50.213510 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064b3aa-ab4a-4724-b443-52e8c950b4c7 admin admin] PATH_INFO: `/v3/users/e3a6966b16f54b6ea0ee80dff1458e1b` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:50.214684 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064b3aa-ab4a-4724-b443-52e8c950b4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a6966b16f54b6ea0ee80dff1458e1b)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:50.216700 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064b3aa-ab4a-4724-b443-52e8c950b4c7 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:50.260833 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5064b3aa-ab4a-4724-b443-52e8c950b4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a6966b16f54b6ea0ee80dff1458e1b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.261406 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5064b3aa-ab4a-4724-b443-52e8c950b4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a6966b16f54b6ea0ee80dff1458e1b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.262001 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5064b3aa-ab4a-4724-b443-52e8c950b4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a6966b16f54b6ea0ee80dff1458e1b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.273214 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5064b3aa-ab4a-4724-b443-52e8c950b4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a6966b16f54b6ea0ee80dff1458e1b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.279893 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-5064b3aa-ab4a-4724-b443-52e8c950b4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a6966b16f54b6ea0ee80dff1458e1b'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.291831 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1440/2874] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:54:50 2022] DELETE /identity/v3/users/e3a6966b16f54b6ea0ee80dff1458e1b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:50.549946 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:50.551404 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:50.564884 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0810817-e693-49ee-8680-554cec553e02 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:50.619310 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:50.620173 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:50.620446 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:50.620712 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] PATH_INFO: `/v3/projects/dd381556f3354ca8a5c91e5518637266` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:50.621875 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd381556f3354ca8a5c91e5518637266)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:50.623808 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:50.667311 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd381556f3354ca8a5c91e5518637266', 'request_id': 'req-e593589f-1f17-40d1-9d98-7fdaf8756500'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.672532 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd381556f3354ca8a5c91e5518637266', 'request_id': 'req-e593589f-1f17-40d1-9d98-7fdaf8756500'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.678295 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd381556f3354ca8a5c91e5518637266', 'request_id': 'req-e593589f-1f17-40d1-9d98-7fdaf8756500'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.689815 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] The token cache is being invalidate because project dd381556f3354ca8a5c91e5518637266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:54:50.690093 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.690692 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-e593589f-1f17-40d1-9d98-7fdaf8756500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:54:50.692209 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1435/2875] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:54:50 2022] DELETE /identity/v3/projects/dd381556f3354ca8a5c91e5518637266 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:50.697121 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68318-fd8f-473c-a812-ca0252d91478 None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:50.697594 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68318-fd8f-473c-a812-ca0252d91478 None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:50.697725 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68318-fd8f-473c-a812-ca0252d91478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:50.715761 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-84f68318-fd8f-473c-a812-ca0252d91478 None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:50.716947 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-84f68318-fd8f-473c-a812-ca0252d91478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:50.773224 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1441/2876] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:54:50.831964 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b76e-194c-4208-9b32-53836d438a6d None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:50.832161 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b76e-194c-4208-9b32-53836d438a6d None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:50.832422 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b76e-194c-4208-9b32-53836d438a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:50.850667 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-5685b76e-194c-4208-9b32-53836d438a6d None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:50.851885 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-5685b76e-194c-4208-9b32-53836d438a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:50.860237 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1436/2877] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:50.864410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68318-fd8f-473c-a812-ca0252d91478 None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:50.874137 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68318-fd8f-473c-a812-ca0252d91478 None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:50.878872 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f8159-2bee-4418-9519-c97fed307946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:50.879553 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8159-2bee-4418-9519-c97fed307946 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:50.879830 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8159-2bee-4418-9519-c97fed307946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:50.880099 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8159-2bee-4418-9519-c97fed307946 admin admin] PATH_INFO: `/v3/domains` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:50.880805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f8159-2bee-4418-9519-c97fed307946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:54:50.881106 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f8159-2bee-4418-9519-c97fed307946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:50.882667 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f8159-2bee-4418-9519-c97fed307946 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:50.893649 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1442/2878] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Feb 28 10:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:54:50.897588 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b76e-194c-4208-9b32-53836d438a6d None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:50.907045 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b76e-194c-4208-9b32-53836d438a6d None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:50.911626 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d1843-607b-4036-a9e2-f684472f551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:50.912251 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d1843-607b-4036-a9e2-f684472f551f admin admin] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:50.912527 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d1843-607b-4036-a9e2-f684472f551f admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:50.912794 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d1843-607b-4036-a9e2-f684472f551f admin admin] PATH_INFO: `/v3/projects` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:50.913464 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d1843-607b-4036-a9e2-f684472f551f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:50.916030 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d1843-607b-4036-a9e2-f684472f551f admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:50.939849 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1437/2879] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Feb 28 10:54:50 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:54:50.943805 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f8159-2bee-4418-9519-c97fed307946 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:50.953338 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f8159-2bee-4418-9519-c97fed307946 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:51.008161 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d647958-9daf-4ede-b7c7-fa6931d1c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:51.009340 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647958-9daf-4ede-b7c7-fa6931d1c6ed admin admin] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:51.009642 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647958-9daf-4ede-b7c7-fa6931d1c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:51.009921 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647958-9daf-4ede-b7c7-fa6931d1c6ed admin admin] PATH_INFO: `/v3/users` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:51.010619 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d647958-9daf-4ede-b7c7-fa6931d1c6ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:51.012575 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d647958-9daf-4ede-b7c7-fa6931d1c6ed admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:51.033621 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1443/2880] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Feb 28 10:54:50 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:54:51.037729 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d1843-607b-4036-a9e2-f684472f551f admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:51.047783 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d1843-607b-4036-a9e2-f684472f551f admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:51.052313 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe3c4-42eb-47cd-873f-0c2e5cd04df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:51.052952 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe3c4-42eb-47cd-873f-0c2e5cd04df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:51.053256 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe3c4-42eb-47cd-873f-0c2e5cd04df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:51.053529 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe3c4-42eb-47cd-873f-0c2e5cd04df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:51.054241 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe3c4-42eb-47cd-873f-0c2e5cd04df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:51.055880 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe3c4-42eb-47cd-873f-0c2e5cd04df5 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:51.065774 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1438/2881] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:51.069431 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d647958-9daf-4ede-b7c7-fa6931d1c6ed admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:51.079402 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d647958-9daf-4ede-b7c7-fa6931d1c6ed admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:51.084125 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a65f1-2006-4af4-b368-e3891a630236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:51.084773 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a65f1-2006-4af4-b368-e3891a630236 admin admin] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:51.085057 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a65f1-2006-4af4-b368-e3891a630236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:51.085331 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a65f1-2006-4af4-b368-e3891a630236 admin admin] PATH_INFO: `/v3/roles` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:51.086042 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a65f1-2006-4af4-b368-e3891a630236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:51.088252 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a65f1-2006-4af4-b368-e3891a630236 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:51.098031 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1444/2882] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Feb 28 10:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:54:51.102099 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe3c4-42eb-47cd-873f-0c2e5cd04df5 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:51.111960 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe3c4-42eb-47cd-873f-0c2e5cd04df5 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:51.116679 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e95a8-8e48-439e-ba69-bc9aea2dc619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:51.117533 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e95a8-8e48-439e-ba69-bc9aea2dc619 admin admin] REQUEST_METHOD: `PUT` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:51.117812 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e95a8-8e48-439e-ba69-bc9aea2dc619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:51.118084 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e95a8-8e48-439e-ba69-bc9aea2dc619 admin admin] PATH_INFO: `/v3/projects/d8415bdcbb1441c79b56efeece752653/users/1ce38c4a2b4347dbb117f03d52327392/roles/f8641f824b324fa2956c5fc5b764f8ae` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:51.132227 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e95a8-8e48-439e-ba69-bc9aea2dc619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8415bdcbb1441c79b56efeece752653, user_id=1ce38c4a2b4347dbb117f03d52327392, role_id=f8641f824b324fa2956c5fc5b764f8ae)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:51.135403 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e95a8-8e48-439e-ba69-bc9aea2dc619 admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:51.149920 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1439/2883] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Feb 28 10:54:51 2022] PUT /identity/v3/projects/d8415bdcbb1441c79b56efeece752653/users/1ce38c4a2b4347dbb117f03d52327392/roles/f8641f824b324fa2956c5fc5b764f8ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:54:51.159977 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412bcd2-b7dc-464c-99ab-d0a2f4a94f0d None None] REQUEST_METHOD: `POST` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:51.160267 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412bcd2-b7dc-464c-99ab-d0a2f4a94f0d None None] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:51.160539 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412bcd2-b7dc-464c-99ab-d0a2f4a94f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:51.187250 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.auth.core [None req-5412bcd2-b7dc-464c-99ab-d0a2f4a94f0d None None] MFA Rules not processed for user `1ce38c4a2b4347dbb117f03d52327392`. Rule list: `[]` (Enabled: `True`). {{(pid=79326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:54:51.188432 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-5412bcd2-b7dc-464c-99ab-d0a2f4a94f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:51.249882 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1445/2884] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:54:51.261585 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e95a8-8e48-439e-ba69-bc9aea2dc619 admin admin] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:54:51.263335 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-124e95a8-8e48-439e-ba69-bc9aea2dc619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:54:51.316891 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e95a8-8e48-439e-ba69-bc9aea2dc619 admin admin] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:54:51.320539 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8dd98-8da4-4e41-a8b7-a88aad59d220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1c59b4bb1774e1badd132071859f503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:54:51.321652 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8dd98-8da4-4e41-a8b7-a88aad59d220 service cinder] REQUEST_METHOD: `GET` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:54:51.321931 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8dd98-8da4-4e41-a8b7-a88aad59d220 service cinder] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:54:51.322204 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8dd98-8da4-4e41-a8b7-a88aad59d220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:54:51.330283 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8dd98-8da4-4e41-a8b7-a88aad59d220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:54:51.331727 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8dd98-8da4-4e41-a8b7-a88aad59d220 service cinder] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:54:51.341218 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1440/2885] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:54:51 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:55:33.183519 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412bcd2-b7dc-464c-99ab-d0a2f4a94f0d None None] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:55:33.241777 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412bcd2-b7dc-464c-99ab-d0a2f4a94f0d None None] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:55:33.246827 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:55:33.247692 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:55:33.247989 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:55:33.248245 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] PATH_INFO: `/v3/users/1ce38c4a2b4347dbb117f03d52327392` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:55:33.249410 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce38c4a2b4347dbb117f03d52327392)` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:55:33.251337 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:55:33.294789 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce38c4a2b4347dbb117f03d52327392'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:55:33.295399 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce38c4a2b4347dbb117f03d52327392'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:55:33.296009 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce38c4a2b4347dbb117f03d52327392'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:55:33.307917 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce38c4a2b4347dbb117f03d52327392'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:55:33.314647 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.notifications [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce38c4a2b4347dbb117f03d52327392'} {{(pid=79326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:55:33.326285 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1446/2886] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Feb 28 10:55:33 2022] DELETE /identity/v3/users/1ce38c4a2b4347dbb117f03d52327392 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:55:33.330803 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeb8c7-014e-45e0-b7fd-03a76d614b7c None None] REQUEST_METHOD: `POST` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:55:33.331358 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeb8c7-014e-45e0-b7fd-03a76d614b7c None None] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:55:33.331457 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeb8c7-014e-45e0-b7fd-03a76d614b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:55:33.348516 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.auth.core [None req-97aeb8c7-014e-45e0-b7fd-03a76d614b7c None None] MFA Rules not processed for user `870ce38416184f81819ea6b48f497b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:55:33.349685 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-97aeb8c7-014e-45e0-b7fd-03a76d614b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:55:33.404696 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1441/2887] 10.222.0.44 () {58 vars in 957 bytes} [Mon Feb 28 10:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:55:33.415019 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:55:33.416414 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:55:33.475184 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3d08-6a4a-4a3b-9394-42e41f9466d3 admin admin] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:55:33.480718 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af026-b4e0-447e-b0d5-fc9079d04c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44fb3491570c41cbb7271cfce1c31e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:55:33.481380 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af026-b4e0-447e-b0d5-fc9079d04c74 service neutron] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:55:33.481664 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af026-b4e0-447e-b0d5-fc9079d04c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:55:33.481938 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af026-b4e0-447e-b0d5-fc9079d04c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:55:33.492395 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409af026-b4e0-447e-b0d5-fc9079d04c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:55:33.493820 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409af026-b4e0-447e-b0d5-fc9079d04c74 service neutron] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:55:33.504230 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1447/2888] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:55:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:55:33.760321 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeb8c7-014e-45e0-b7fd-03a76d614b7c None None] Authenticating user token {{(pid=79327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:55:33.761833 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.fernet_utils [None req-97aeb8c7-014e-45e0-b7fd-03a76d614b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:55:33.776871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeb8c7-014e-45e0-b7fd-03a76d614b7c None None] Validating token access rules against request {{(pid=79327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:55:33.781494 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '870ce38416184f81819ea6b48f497b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df99af6079f04b40ae2fb2b304eafd0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:55:33.782342 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:55:33.782610 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] SCRIPT_NAME: `/identity` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:55:33.782867 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] PATH_INFO: `/v3/projects/d8415bdcbb1441c79b56efeece752653` {{(pid=79327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:55:33.784110 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8415bdcbb1441c79b56efeece752653)` {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:55:33.786014 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] RBAC: Authorization granted {{(pid=79327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:55:33.832654 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8415bdcbb1441c79b56efeece752653', 'request_id': 'req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:55:33.838713 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8415bdcbb1441c79b56efeece752653', 'request_id': 'req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:55:33.844871 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8415bdcbb1441c79b56efeece752653', 'request_id': 'req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e'} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:55:33.856538 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] The token cache is being invalidate because project d8415bdcbb1441c79b56efeece752653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:55:33.856820 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:55:33.857422 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: DEBUG keystone.notifications [None req-cc6bab7b-ea0c-4b70-ae6d-1d79493dd34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:55:33.858945 dv-cinder-831167-1-iscsi devstack@keystone.service[79327]: [pid: 79327|app: 0|req: 1442/2889] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Feb 28 10:55:33 2022] DELETE /identity/v3/projects/d8415bdcbb1441c79b56efeece752653 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:57:12.388460 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af026-b4e0-447e-b0d5-fc9079d04c74 service neutron] Authenticating user token {{(pid=79326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:57:12.389854 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-409af026-b4e0-447e-b0d5-fc9079d04c74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:57:12.456032 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af026-b4e0-447e-b0d5-fc9079d04c74 service neutron] Validating token access rules against request {{(pid=79326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:57:12.511864 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baa473-c224-4648-a5ed-684ae993ba28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee30c8013ebb40a99d1eac7820d7f1f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da6b83a381114e5eb99dd77e01292829', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:57:12.512493 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baa473-c224-4648-a5ed-684ae993ba28 service placement] REQUEST_METHOD: `GET` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:57:12.512768 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baa473-c224-4648-a5ed-684ae993ba28 service placement] SCRIPT_NAME: `/identity` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:57:12.513038 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baa473-c224-4648-a5ed-684ae993ba28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:57:12.514780 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.fernet_utils [None req-48baa473-c224-4648-a5ed-684ae993ba28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:57:12.526144 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baa473-c224-4648-a5ed-684ae993ba28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:57:12.527770 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baa473-c224-4648-a5ed-684ae993ba28 service placement] RBAC: Authorization granted {{(pid=79326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:57:12.542145 dv-cinder-831167-1-iscsi devstack@keystone.service[79326]: [pid: 79326|app: 0|req: 1448/2890] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Feb 28 10:57:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)